-- Logs begin at Tue 2021-10-12 16:06:23 UTC, end at Tue 2021-10-12 17:11:35 UTC. -- Oct 12 16:40:07.637608 dv-cinder-813223-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 16:40:07.648975 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 16:40:07.651048 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 16:40:07 2021] *** Oct 12 16:40:07.651048 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 16:40:07.651048 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: nodename: dv-cinder-813223-2-iscsi Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: machine: x86_64 Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: clock source: unix Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: pcre jit disabled Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: detected number of CPU cores: 4 Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: current working directory: / Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: detected binary path: /usr/bin/uwsgi-core Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: your processes number limit is 47680 Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: your memory page size is 4096 bytes Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: detected max file descriptor number: 2048 Oct 12 16:40:07.651270 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: lock engine: pthread robust mutexes Oct 12 16:40:07.651803 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: thunder lock: enabled Oct 12 16:40:07.651803 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 16:40:07.651803 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 16:40:07.697329 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: Python main interpreter initialized at 0x55bd5b2b99c0 Oct 12 16:40:07.697329 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: python threads support enabled Oct 12 16:40:07.697329 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: your server socket listen backlog is limited to 100 connections Oct 12 16:40:07.697329 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: your mercy for graceful operations on workers is 90 seconds Oct 12 16:40:07.697676 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 16:40:07.697738 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: *** Operational MODE: preforking *** Oct 12 16:40:07.698050 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: *** uWSGI is running in multiple interpreter mode *** Oct 12 16:40:07.698050 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: spawned uWSGI master process (pid: 73549) Oct 12 16:40:07.698264 dv-cinder-813223-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 12 16:40:07.699764 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: spawned uWSGI worker 1 (pid: 73567, cores: 1) Oct 12 16:40:07.699764 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: spawned uWSGI worker 2 (pid: 73568, cores: 1) Oct 12 16:40:07.699887 dv-cinder-813223-2-iscsi devstack@keystone.service[73549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 16:40:12.736096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:40:12.736096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: from cryptography.utils import int_from_bytes Oct 12 16:40:12.737407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:40:12.737407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: from cryptography.utils import int_from_bytes Oct 12 16:40:12.737809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:40:12.737809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: from cryptography.utils import int_from_bytes Oct 12 16:40:12.737910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:40:12.737910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: from cryptography.utils import int_from_bytes Oct 12 16:40:12.785704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:40:12.785862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:40:12.785946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:40:12.786041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:40:12.786120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] command line args: [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:40:12.786196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] command line args: [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:40:12.786328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:40:12.786414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:40:12.786493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ================================================================================ {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:40:12.786568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ================================================================================ {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:40:12.786745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] admin_token = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.786828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] admin_token = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.786993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] config_dir = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] config_dir = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] config_source = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] config_source = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] debug = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] debug = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.787958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.788967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_config_append = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_config_append = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_dir = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_dir = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_file = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_file = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.789897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.790939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.791947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.792999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.793172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.793346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.793516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.793690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.793863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.794928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] publish_errors = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] publish_errors = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.795913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] standard_threads = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] standard_threads = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.796903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] use_journal = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] use_journal = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.797957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] use_json = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.798081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] use_json = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.798194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] use_stderr = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.798312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] use_stderr = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.798430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] use_syslog = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.798619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] use_syslog = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.799255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.799372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:40:12.799490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.799604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.799716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.799868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.799868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.800881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.801966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.802909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.803956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.804872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.805916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.806901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.807945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.808839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.809973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.810899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.811943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.812978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.813938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.814928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.815968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.816896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.817948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.818982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.819910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.820971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.external = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.external = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.821902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.password = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.password = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] auth.token = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] auth.token = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.822948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.823991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.824893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.825986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.826965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.827889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.828937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.829889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.830959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.831968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.832912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.833909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.834950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.835883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.836928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837766 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.837879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.838924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.839967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.840794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.841975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.842898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.843958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.844931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.845078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.845195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.845315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.845911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.846960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.847886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.848923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.849890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.850926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.851969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.852876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.853792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.854931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] role.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] role.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] role.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] role.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.855963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.856887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.857943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858523 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.858996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.859916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.860976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.861693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.861821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.861937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.862992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.863900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.864832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.865946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.866991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.867917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.connection = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.connection = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.868971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.869911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.870982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.871912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.872026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.872140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.872264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.872380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:40:12.872494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:40:12.872609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:40:12.898057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.898200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.898294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.898484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.898560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.898634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.908968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.909229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.937851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.938112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.938213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.938298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.990900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:12.991192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.131319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.131553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.132215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.132448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.196849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.197923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.198014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.222948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.223038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.223157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.223246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.223367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.223455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.234431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.234758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.246965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.247142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.247367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.247589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.247804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73568) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.248891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.249124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.249335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73567) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:40:13.266034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.266241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:40:13.266551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.266651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.266759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:40:13.266898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:40:13.267026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.267116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.267276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:40:13.267963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.268820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.278845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.279849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.280131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.289483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.290003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.292667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.292983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.293192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.293287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.293462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.293546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.293737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.293822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.294869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.295828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.321534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.322191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.323115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.323391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.323764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.324037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.328515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.328782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.329095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.329347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.329621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.330537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.336811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.337121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.337606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.337898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.341470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.341750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.342307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.342857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.343843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.344105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.361862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.362126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.362761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.363034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.366589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.367515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.370141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.370429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.371185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.371470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.375475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.376340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.379768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.380682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.384952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.384952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.384952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.384952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.385577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.403899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.404176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.404439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.404699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.404889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.405193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.405456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.405725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.412411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.413419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.414104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.414373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.415075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.415345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.417506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.417783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.418075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.418373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.418467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.418648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.418755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.419004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.419285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.419558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.431605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.431871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.432146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.432430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.432516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.432706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.432812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.432991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.433080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.433262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.433454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.433728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.433998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.434268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.451181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.452278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.454382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.456031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.458252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.459270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.459820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.460962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.461550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.461831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.462136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.462551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.462825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.463106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.469224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.470471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.470802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.472042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.473967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.474252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.474531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.474809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.475319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.475603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.475982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.476266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.483788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.484074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.484347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.485315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.485466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.485738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.492002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73568) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.492284 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.492558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.492827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.493138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.493406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.493488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73567) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:40:13.493672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.493765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.493949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.494935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73568) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.495906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.496181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.496444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.496703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.497017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73567) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:40:13.534606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd5b2b99c0 pid: 73568 (default app) Oct 12 16:40:13.535197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd5b2b99c0 pid: 73567 (default app) Oct 12 16:40:13.538888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f948e-8f05-48e4-a880-2a59d5e63638 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:13.539176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f948e-8f05-48e4-a880-2a59d5e63638 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:13.539449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f948e-8f05-48e4-a880-2a59d5e63638 None None] PATH_INFO: `/v3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:13.543648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Oct 12 16:40:13 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:21.195056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:21.195566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:21.195690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:21.200642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:21 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:21.206619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:21.207011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:21.207162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:21.237882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG oslo_db.sqlalchemy.engines [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:40:21.428256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG passlib.handlers.bcrypt [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73568) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:40:21.428682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG passlib.handlers.bcrypt [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73568) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:40:21.486844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:21.487289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:21.632144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:21.782287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:21.815269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG oslo_db.sqlalchemy.engines [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:40:21.944363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c3814-6d63-4445-b6ff-94dcc1e3bb38 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:21.948675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:21.949364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:21.949649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:21.949925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:21.958546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:22.010764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.common.rbac_enforcer.enforcer [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:40:22.011096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffa601-8a00-42c5-9c0b-a9d8490c0dbf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:22.021238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:22.029377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:22.043496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ed21-5d33-436c-a885-5361c52dd3cd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:22.047902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:22.049038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:22.049324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:22.049599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:22.051117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0ea88d5877948298aefb26cf4ba2957)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:22.102131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.common.rbac_enforcer.enforcer [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:40:22.102483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166704fb-7f03-4d8a-8fbe-7b9c394a0675 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:22.106979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:22 2021] GET /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:24.339841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff8c5-47d2-4cdb-8a34-7127f743d9d8 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:24.340349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff8c5-47d2-4cdb-8a34-7127f743d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:24.340516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff8c5-47d2-4cdb-8a34-7127f743d9d8 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:24.344890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:24.351045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:24.351432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:24.351600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:24.371570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:24.373122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:24.382571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:24.406459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff8c5-47d2-4cdb-8a34-7127f743d9d8 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:24.421009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff8c5-47d2-4cdb-8a34-7127f743d9d8 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:24.425385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:24.426023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:24.426306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:24.426583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:24.434709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:24.436500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e1248-c876-477d-8a03-25418ba61a0a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:24.445780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:24.452105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:24.461605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611004-da29-41ab-bd16-fdb356396fe5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:24.465992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:24.466849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:24.467132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:24.467405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:24.468806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:24.470678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0727-9f5c-4d28-9763-9c36503d83b1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:24.472527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:24 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:26.734687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a0b94-a06b-4a9e-8fe5-68cefd39bb40 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.735216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a0b94-a06b-4a9e-8fe5-68cefd39bb40 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.735216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a0b94-a06b-4a9e-8fe5-68cefd39bb40 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.737652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:26.743690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.744126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.744426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.762055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:26.763239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:26.771300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:26.795268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306687-b0ce-48db-8117-c542eda0ffb3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.795549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306687-b0ce-48db-8117-c542eda0ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.795825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b306687-b0ce-48db-8117-c542eda0ffb3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.796253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.797583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 6/12] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:26.803163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.803445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.803719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.805266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acac1a-8441-4a18-a344-454c999f824e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.809592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.810362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.810641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.810913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.823575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:26.830978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:26.832141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 7/13] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:26.838433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.846023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG passlib.handlers.bcrypt [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73567) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:40:26.846444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG passlib.handlers.bcrypt [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73567) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:40:26.848415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821854a7-a27a-4a82-8d19-3c3a9a545d6e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.852931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.853579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.853857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.854126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.854871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:26.855268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:26.856916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:26.856916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:26.856916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:26.857847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:26.870140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 8/14] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:26.876073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.885255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420964-88c2-4bca-8641-a4b53ca8ff3a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.889589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.890402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.890705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.890925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.892618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:26.892845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:26.894416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:26.894515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:26.897107 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 9/15] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:26.901532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.911249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d9ae-bfd1-44f4-9dd4-47c665826d32 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.915586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.916323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.916599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.916871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.918068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:26.919742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:26.921509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 10/16] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:26.921939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 7/17] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:26.927315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.936465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37ce7d-4aed-4058-b068-45dcc05f02da admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.940797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.941430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.941710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.941979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.942801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.domain.id=default, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:26.943103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:26.944083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:26.944083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:26.944083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:26.944655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.945245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:26.951849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 11/18] 10.222.0.42 () {56 vars in 1343 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.domain.id=default&role.id=4fc92071567747e89f2e86ecec30229e => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:26.953722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10528-c833-401a-8043-4aaf6f5c79ef None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:26.958994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:26.960019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:26.960302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:26.960576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:26.969753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:26.972332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02139f-c982-49c5-a2ff-7e699218a189 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:26.982510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 8/19] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:26.989060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:26.999536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1cb63-309d-469a-9e1e-9378e58c67ff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:27.004834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:27.005793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:27.006165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:27.006508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:27.007885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:27.009702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04534df0-c186-4d50-8637-82c146822fdd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:27.011410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 12/20] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:29.404056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8383-0b6c-4eb2-b350-e4ace5272f11 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.405059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8383-0b6c-4eb2-b350-e4ace5272f11 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.405545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8383-0b6c-4eb2-b350-e4ace5272f11 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.407901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 9/21] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:29.414402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.415323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.415817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.434856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:29.436413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:29.451341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:29.487528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8383-0b6c-4eb2-b350-e4ace5272f11 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:29.503479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8383-0b6c-4eb2-b350-e4ace5272f11 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:29.508218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:29.509388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.509882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.510365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.533887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:29.541328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:29.542906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 10/23] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:29.549479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:29.559101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bc920-1a50-47fb-98f2-dbc6ca6aa55e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:29.564502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:29.565450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.565956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.566429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.567405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:29.567909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:29.569798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:29.579369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 14/24] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:29.586313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:29.597170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023317e0-ac3f-4696-9332-e1a8ecbc79ee admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:29.604785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:29.606038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.606557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.607028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.608837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:29.611266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:29.613194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 11/25] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:29 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:29.621899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:29.634136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9c03-2aee-49ee-8a5d-1f5feb447aee admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:29.647554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:29.648890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.649441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.649908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.651442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:29.653414 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83025f-d214-40e2-8b5a-14d7688441eb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:29.655334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 15/26] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:29.662378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:29.679608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af2de-711c-413e-8bf6-062e7349e1a8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:29.684642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:29.685764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:29.686228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:29.686705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] PATH_INFO: `/v3/domains/default/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:29.689587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=12c2b7d3088e4259a65e864f8c35d8fd, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:29.694542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:29.694542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:29.694542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:29.696868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e12f4-7db8-4428-9cf9-ee1f6c66e7f1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:29.843566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 12/27] 10.222.0.42 () {58 vars in 1382 bytes} [Tue Oct 12 16:40:29 2021] PUT /identity/v3/domains/default/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:30.051938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ede78-bb58-4f78-b9ba-5ac65f9f6974 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.052458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ede78-bb58-4f78-b9ba-5ac65f9f6974 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.052906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ede78-bb58-4f78-b9ba-5ac65f9f6974 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.055603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 16/28] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:30.065986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ec67-4186-4b96-8434-45ee073e4e47 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.066679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ec67-4186-4b96-8434-45ee073e4e47 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.067102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8ec67-4186-4b96-8434-45ee073e4e47 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.070247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.070247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.070247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.072555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 13/29] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:30 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:30.078942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.079524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.079952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.092374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:30.093675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:30.116128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:30.118158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:30.203403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:30.246179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 14/31] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 16:40:30.253135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:30.268439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee706b4-9b61-4748-b10f-d74e12f9eb13 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:30.273138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:30.273810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.274094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.274369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.275149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:30.276161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:30.276161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:30.276161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:30.277106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27827e-9e76-43d3-9df9-6f351e85affd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:30.287776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:30.300365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0d5e-25ac-4e0e-8b64-929f8868d151 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:30.316053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:30.316866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.317176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.317453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.346157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:30.348112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:30.381950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:40:30.383515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 15/32] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:30.389654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:30.399950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f66a-d26a-4aa0-b779-ead6e099073a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:30.404771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:30.406123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.406542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.406960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.408366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:30.408819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:30.410058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:30.410058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:30.410058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:30.411246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a9119-7de0-4bcf-b6d1-493bdf893492 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:30.431790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:40:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:30.433402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894185-6996-40fa-bc3d-15ba3c1b18bf None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.433830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894185-6996-40fa-bc3d-15ba3c1b18bf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.434266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78894185-6996-40fa-bc3d-15ba3c1b18bf None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.436332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 17/34] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:30.437401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78894185-6996-40fa-bc3d-15ba3c1b18bf None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:30.461348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78894185-6996-40fa-bc3d-15ba3c1b18bf None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:30.466115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:30.466960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.467384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.467798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.468666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:30.469839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:30.469839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:30.469839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:30.471407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:30.474114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 18/35] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/roles => generated 219 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:30.475694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07993-9380-407e-8951-f451058e7823 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.475984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07993-9380-407e-8951-f451058e7823 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.480997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07993-9380-407e-8951-f451058e7823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.516723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8eb07993-9380-407e-8951-f451058e7823 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:30.518464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8eb07993-9380-407e-8951-f451058e7823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:30.526668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/projects => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:40:30.620733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 19/37] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:30.664388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:30.677129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdcba-ee83-4fa9-b8e5-1cef0c5900aa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:30.690524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:30.691567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:30.692075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:30.692547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:30.693570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:30.694798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:30.694798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:30.694798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:30.696116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9113-7d52-4e16-b187-4811037e7448 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:30.727223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 19/38] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:40:30 2021] POST /identity/v3/roles => generated 225 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:31.410486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b9d7-7326-4ffd-b502-9ef629252aa0 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.410833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b9d7-7326-4ffd-b502-9ef629252aa0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.411057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b9d7-7326-4ffd-b502-9ef629252aa0 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.412893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 20/39] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:31.419390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74668-b0db-4833-816e-22732a0f37d1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.419864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74668-b0db-4833-816e-22732a0f37d1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.420049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74668-b0db-4833-816e-22732a0f37d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.439620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-68c74668-b0db-4833-816e-22732a0f37d1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:31.440812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-68c74668-b0db-4833-816e-22732a0f37d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:31.449584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:31.473904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b9d7-7326-4ffd-b502-9ef629252aa0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:31.486631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b9d7-7326-4ffd-b502-9ef629252aa0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:31.491460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:31.492147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.492432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.492710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.493551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:31.495443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:31.497528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7175-f284-456f-9061-5f85357a55c3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.498012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7175-f284-456f-9061-5f85357a55c3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.498109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7175-f284-456f-9061-5f85357a55c3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.499884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 21/41] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:31.506638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.506929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.507210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.510339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:40:31 2021] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:31.527144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:31.528379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:31.537179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:31.561079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:31.571449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453905fc-8f70-4714-8f4e-4aca42302fdf admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:31.576439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:31.577297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.577577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.577850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.579106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:31.581488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b013-2ae6-4781-92e8-08a6b4e2fc22 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:31.583521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 22/44] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:31.589920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:31.600171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff714d-ec55-4444-8e35-40f3090b5c35 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:31.604735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:31.605447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.605728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.606002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.606747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:31.608723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a0f48-8f1e-43fc-89a9-6604d4059a07 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:31.640177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:40:31 2021] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:32.570348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b412b-2c2f-487b-a551-70f990fb6033 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.570829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b412b-2c2f-487b-a551-70f990fb6033 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.570829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b412b-2c2f-487b-a551-70f990fb6033 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.572721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 23/46] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:32.578818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.579225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.579379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.598269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:32.599452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:32.658206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 24/47] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:32.684000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b412b-2c2f-487b-a551-70f990fb6033 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:32.696403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b412b-2c2f-487b-a551-70f990fb6033 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:32.700610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:32.701453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.701737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.702011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.711915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:32.718776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:32.720430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:32.726777 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:32.736231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b878b-9b20-4a92-adba-9d07653e279e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:32.740622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:32.741316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.741602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.741877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.742638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:32.742945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:32.743955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:32.743955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:32.743955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:32.744874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:32.758171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:32.764285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:32.775755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d987d42-654e-4910-b022-6582b78f5542 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:32.780277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:32.781162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.781442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.781710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.783567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:32.785445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:32.787057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:32 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:32.792960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:32.802545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8100b0-aaea-42f3-9f37-b890b2256e75 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:32.806877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:32.807662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.807938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.808208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.809425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:32.811132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3dbdd-fd69-4c41-b1d6-20e73bc89c93 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:32.812707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 26/51] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:32.819375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:32.829662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab758c-498c-4ac0-96db-468f1217205e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:32.833936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:32.834572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:32.834856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:32.835134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:32.835981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.domain.id=default, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:32.836299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:32.838184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00af2-d7bc-4b02-9835-cee62acfcfc9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:32.843870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1343 bytes} [Tue Oct 12 16:40:32 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.domain.id=default&role.id=4fc92071567747e89f2e86ecec30229e => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:33.976788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085a3-51fb-4618-9626-74695eabde0a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:33.977332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085a3-51fb-4618-9626-74695eabde0a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:33.977420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707085a3-51fb-4618-9626-74695eabde0a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:33.979173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 27/53] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:33.985002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:33.985426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:33.985566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:34.003737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:34.004967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:34.012738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:34.038422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707085a3-51fb-4618-9626-74695eabde0a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:34.050420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707085a3-51fb-4618-9626-74695eabde0a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:34.054658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:34.055447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:34.055735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:34.056012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:34.057229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:34.058949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd962-fe13-41c7-899f-07ae1d75bbae admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:34.060520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:34.067187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:34.075945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110a93e-b1b2-461f-9b15-fbe130fcb2c4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:34.080968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:34.081618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:34.081901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:34.082175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:34.082899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:34.083935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:34.083935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:34.083935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:34.085239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158c3cd-9dd8-4691-b81b-8b1a9340d38d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:34.110244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 28/56] 10.222.0.42 () {60 vars in 1161 bytes} [Tue Oct 12 16:40:34 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:40:36.324511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cdbd-5f14-4858-8eb9-424cb3e5e227 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:36.324997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cdbd-5f14-4858-8eb9-424cb3e5e227 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:36.325084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cdbd-5f14-4858-8eb9-424cb3e5e227 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:36.326866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 29/57] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:36.332670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:36.333109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:36.333254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:36.350973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:36.352161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:36.406655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 29/58] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:36.432887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362cdbd-5f14-4858-8eb9-424cb3e5e227 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:36.444782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362cdbd-5f14-4858-8eb9-424cb3e5e227 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:36.449064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:36.449837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:36.450121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:36.450400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:36.451588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:36.453351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20575762-5257-4dfa-8ec4-aa06fd9cbcb9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:36.454934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:36.460743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:36.469610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e84b-acb6-4169-8a35-783970b3b3d5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:36.474699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:36.475422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:36.475714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:36.475990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:36.476729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:36.477805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:36.477805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:36.477805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:36.479639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a45cff-7598-4dfc-90d1-49c1444d218e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:36.509194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 30/60] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:40:36 2021] POST /identity/v3/users => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:39.939797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6a99-d184-481a-8546-3506863442fb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:39.940841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6a99-d184-481a-8546-3506863442fb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:39.941340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f6a99-d184-481a-8546-3506863442fb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:39.943809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 31/61] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:39.949780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:39.950633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:39.951102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:39.975614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:39.977214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:39.991679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 31/62] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:40.042426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f6a99-d184-481a-8546-3506863442fb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.058519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f6a99-d184-481a-8546-3506863442fb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.063244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.064800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.065298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.065795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.082613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:40.089945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-52167b1a-a3c3-4011-b009-3867bee0e313 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:40.091359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 32/63] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:40.098087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.107588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b48d-f5f3-4e22-a756-873d058b7f77 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.117128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5469ed2-94af-433a-8c63-1eb12e6444bf None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.117693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5469ed2-94af-433a-8c63-1eb12e6444bf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.118180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5469ed2-94af-433a-8c63-1eb12e6444bf None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.120163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:40.121689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.122622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.123103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.123579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.124726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.126772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.127252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.127711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.130532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.132386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.153962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 32/65] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.161749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.165752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:40.167363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:40.178795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2736b0-8019-437f-a15e-e618ba17ec24 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.184348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:40.195697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.196828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.197339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.197812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.212979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.219243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d5faa-ddf4-4524-a0fd-461b1f6f8cbf None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.224366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.227471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.230431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 33/67] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.237958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.238257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.239041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.239552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.240030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.260587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9c1d-9dab-4547-a329-d9b57f541bab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.262452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:40.269713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:40.274149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.275024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.275524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.275993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.282430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 35/68] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:40.284516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.291419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.293501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.304161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb314-7e72-4ec5-9d90-d7ec111bb8e3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.317049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:40.318626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.319436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.320328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.320770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.321228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.322174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.322996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.324850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a930d1-6dd3-4b97-b7a0-2976be62659e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.334327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179517c0-df08-4b70-aa6f-348ac791650b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.338825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.339741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.340261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092c66d-59c2-4115-8f31-426c0676e592 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.340555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092c66d-59c2-4115-8f31-426c0676e592 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.340833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092c66d-59c2-4115-8f31-426c0676e592 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.341448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.341942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.342413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.342797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 37/71] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:40.344163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.346595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768296e4-5884-4096-8e55-4ecdfd46c9ad admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.348535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092c66d-59c2-4115-8f31-426c0676e592 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.349200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 35/72] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:40.354636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5d8a-23ff-4e96-89b6-095cad1350d1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.355149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5d8a-23ff-4e96-89b6-095cad1350d1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.355664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5d8a-23ff-4e96-89b6-095cad1350d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.368265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092c66d-59c2-4115-8f31-426c0676e592 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.373530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.374556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.374846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.375124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.375597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0afe5d8a-23ff-4e96-89b6-095cad1350d1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:40.377106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.377465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0afe5d8a-23ff-4e96-89b6-095cad1350d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:40.379221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.380994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 38/73] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.381681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.388873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 36/74] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:40.390370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d774-567e-43d9-be73-6586dc7bb585 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.390658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d774-567e-43d9-be73-6586dc7bb585 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.390930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d774-567e-43d9-be73-6586dc7bb585 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.391519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600ef5e-0318-4d76-b94d-d1b9159302bb admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.393166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 37/75] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:40.394052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d774-567e-43d9-be73-6586dc7bb585 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.400231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.401051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.401601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.402055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.403043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.403500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.404632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:40.404632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:40.404632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:40.406365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e928-05f9-4644-b149-4f8e2b353290 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.412544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d774-567e-43d9-be73-6586dc7bb585 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.417040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=910660db5a7a400c8e4accdc9a348623 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.419169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.419461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.419734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.422818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.423842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.424332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.425004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.434322 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.436408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.439365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:40.440715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:40.449210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:40.450511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.459359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 40/78] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:40.465128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.465293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b83a-5c9c-4d3d-89c9-01a1e4b0b994 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.475276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d23c-d692-45e6-8b5e-f7bf4f7e8221 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.476578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.477453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.477737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.478012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.480425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.481727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.482009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.482287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.483841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.486593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeca71-ea6e-4058-9001-f9185eebbea7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.488603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 41/79] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.489788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1b62-f2e3-4904-b26a-1c2f6e7ffc9f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.490078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1b62-f2e3-4904-b26a-1c2f6e7ffc9f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.490354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1b62-f2e3-4904-b26a-1c2f6e7ffc9f None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.490852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:40.492072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 42/80] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:40.496732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1b62-f2e3-4904-b26a-1c2f6e7ffc9f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.505353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:40.505682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1b62-f2e3-4904-b26a-1c2f6e7ffc9f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.507329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 39/81] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:40.508343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.511330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.512376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.512837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.513310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.520309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f3ad-3d35-435e-8fda-c986b339e39f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.525595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.525758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:40.526257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.526538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.526810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.527738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.527970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.529914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.533356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-444567c1-24dc-4f89-8064-0abc312a5b17 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:40.534966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 43/82] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:40.537017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.537017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.537017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.537243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 40/83] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.541596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.548528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baa561-f3b2-4b2d-ab11-591d3d9eed66 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.555021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.555736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.556023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.556308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.557164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.557476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.559215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.566403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:40.567735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:40.569833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 41/84] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.570725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.576442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 44/85] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:40.577419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.589744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5e84-aef6-42ce-8687-6cce0c121c7f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.592403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063162c3-a4b1-4794-8184-0e359e97cc46 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.600758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.601484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.601768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.602046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.602844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.603149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.604771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.605737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.606019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.606289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.608742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.610189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.612619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.614591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 45/86] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.615508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.623722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 42/87] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.624816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.627124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575047-d9f6-4256-8e92-f20596ba4d2e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.632313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.633178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.633462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.633740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.635020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.636757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.638769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 46/88] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.639565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.642857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577c583-9625-4103-8a88-6bd535c45ae2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.647954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.649004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.649491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.649966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.656871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce405c5-279b-4f5b-9d2f-fb82058527bf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.659963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.661715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.662597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.662834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.663035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.663190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.664439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.666689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.668572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 47/89] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.674134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.679912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 43/90] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:40.681146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.685719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d946a-f7ff-42c2-94f8-1283beb5dd5a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.691252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.691923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.692206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.692479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.693252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.694125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4342-3517-497b-9334-12e4388255ce admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.695221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.699626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.700634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.701148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.701627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.711575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.713960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.724722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 44/91] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:40.726504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 48/92] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:40:40 2021] POST /identity/v3/projects => generated 302 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:40.733103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.734566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.742307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1f4c-5ff6-46e0-ae0b-0dba729ecfff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.806991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.807987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.808336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.808684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.810082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.812717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.814495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 45/93] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.821930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.826557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1464-ff1e-40a3-9a13-806b9fc6e358 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.833376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.834734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.835276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.835757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] PATH_INFO: `/v3/projects/db98b0858f614767988c57728bae50ba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.837440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] RBAC: Authorizing `identity:get_project(project_id=db98b0858f614767988c57728bae50ba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.837703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb752df2-fe96-4cb3-a3ba-77286598515d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.840283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.842915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 49/94] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/projects/db98b0858f614767988c57728bae50ba => generated 312 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.849772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:40.853583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.856280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.856822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.857315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.859953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.861201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.865212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d836e-871a-4c7d-9626-f1636d38fa77 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.872015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099c360-3056-426a-b149-6fbb481b2cce admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:40.877305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 46/95] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=374f47211fa14a49969dec56f6247939 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:40.887174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:40.888348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:40.888835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:40.889356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:40.890593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=db98b0858f614767988c57728bae50ba, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:40.891162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:40.893616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2bfef-68f6-4e5e-bf18-6b31dcda2465 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:40.906364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 50/96] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:40 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=db98b0858f614767988c57728bae50ba&role.id=910660db5a7a400c8e4accdc9a348623 => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:42.921048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f34082-437a-4bac-a09a-562727c1df28 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:42.921590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f34082-437a-4bac-a09a-562727c1df28 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:42.921590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f34082-437a-4bac-a09a-562727c1df28 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:42.924157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 47/97] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:42.930360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:42.930796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:42.930889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:42.952505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:42.953712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:42.967322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 51/98] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:43.003602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f34082-437a-4bac-a09a-562727c1df28 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.018731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f34082-437a-4bac-a09a-562727c1df28 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.025495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.026275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.026552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.026819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.037848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:43.044712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:43.045953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 48/99] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:43.052992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.062142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535b95-4777-43c1-b27a-2e0192e50b1a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.073119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.073794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.074072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.074349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.075114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:43.075418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.077057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.088545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 52/100] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.095488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.110015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f763-b0b4-4522-a929-7f361a75e8e7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.119378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.120245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.120524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.120796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.122056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.124237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.126521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 49/101] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.133073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.147130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6735e83-90d5-42dd-a62f-52a98c71d7d0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.154503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.155366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.155641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.155910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.157155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.159278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc41422-f6f4-48e3-94c6-6f110b623d2e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.161141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.167540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.181976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744415-aeb4-4399-8d05-224a4888d855 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.189562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.190512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.190797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.191072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/28c4a9e1cf09468db7274b5d516b04b1/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.193214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37e35b6f6c4f5ab54655361435da7d, user_id=28c4a9e1cf09468db7274b5d516b04b1, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.194231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:43.194231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:43.194231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:43.196187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51216aa9-3c64-4247-88cc-855bece07477 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.217435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 50/103] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:43 2021] PUT /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/28c4a9e1cf09468db7274b5d516b04b1/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:43.422812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e036d-9c74-4cad-8c67-0e82306187eb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.423711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e036d-9c74-4cad-8c67-0e82306187eb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.423901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e036d-9c74-4cad-8c67-0e82306187eb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.425878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 54/104] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:43.432418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.432714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.432876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.451249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17490b-f46e-45c0-b59a-c3be44666051 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.451571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17490b-f46e-45c0-b59a-c3be44666051 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.451797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17490b-f46e-45c0-b59a-c3be44666051 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.453581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 55/105] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:43.459634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.459918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.460196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.467320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:43.469422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:43.490121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:43.491350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:43.551569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 51/106] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:43.580214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 56/107] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:43.582788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.592298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b522a-97e7-4391-97c1-28d31b1dbb96 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.597995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.598790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.599071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.599345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.607281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.610249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:43.618104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:43.619514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 52/108] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:43.622515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19470-766b-4cae-8c27-402f8a70410d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.632649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.633511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.633791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.634070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.634380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.654044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62e49-6daa-423f-8c42-788c1d8ddb92 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.655213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:43.663218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:43.668721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.669583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.669884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.670146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.670939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:43.671239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.673458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.675166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 57/109] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:43.676056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.690120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 53/110] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.692271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc9249-0a65-4a04-9fc1-26c48e2c0487 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.702129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.704759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.705486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.705780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.706058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.706837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:43.707145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.709092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.723779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a037-940f-4cbe-b3cc-e3294f1a774e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.724536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 58/111] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.729049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.730617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.733648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.733937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.734215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.736422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.738299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.749043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 54/112] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:43.749310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21464a-e61c-4a78-8a6e-1aa6709561fe admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.754296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.755198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.755482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.755761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.757177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.757779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.759398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.761367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 59/113] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:43.768502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.772704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c9752-4c55-47d6-913f-efdea9e75750 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.785183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec302a2-830e-4840-ae7a-eaaa172a794e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.788086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.788981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.789277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.789556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.791228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.793379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.795306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 55/114] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:43.799188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.800089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.800346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.800619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.801890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.804086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.806020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 60/115] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:43.806789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.819411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.823771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807aa2-6d4c-40d2-9563-80dd2b4d16c6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.834554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e408e-72ee-4f0a-9b7b-50779afb1271 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.837025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.837921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.838206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.838481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.840488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37e35b6f6c4f5ab54655361435da7d, user_id=12c2b7d3088e4259a65e864f8c35d8fd, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.843225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f3bbd-b4b8-49de-ac08-cccb7a80b04f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.849688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.850798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.851169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.851396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/28c4a9e1cf09468db7274b5d516b04b1/roles/374f47211fa14a49969dec56f6247939` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.855096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37e35b6f6c4f5ab54655361435da7d, user_id=28c4a9e1cf09468db7274b5d516b04b1, role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.857967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aa025-8efc-4ba7-a15c-8f17bdafa0e2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.860427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 56/116] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:43 2021] PUT /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:43.892935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 61/117] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:43 2021] PUT /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/users/28c4a9e1cf09468db7274b5d516b04b1/roles/374f47211fa14a49969dec56f6247939 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:43.931227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b7eb-b11e-46b0-a8f5-88407b418e53 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.932258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b7eb-b11e-46b0-a8f5-88407b418e53 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.932835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b7eb-b11e-46b0-a8f5-88407b418e53 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.935117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 57/118] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:43.942064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.942556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.942556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.970899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:43.972148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:44.056302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 62/119] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:44.085942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b7eb-b11e-46b0-a8f5-88407b418e53 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.104030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b7eb-b11e-46b0-a8f5-88407b418e53 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.113704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.114876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.115380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.115875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.135489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:44.143875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-433c51da-8650-4e89-a205-0e8ac4ec3322 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:44.145555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 58/120] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:44.154377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.165549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae89a09-fb62-4f6a-b7d5-4b9e6356ed64 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.165960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae89a09-fb62-4f6a-b7d5-4b9e6356ed64 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.166082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae89a09-fb62-4f6a-b7d5-4b9e6356ed64 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.168491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 59/121] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:44.168772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e13f6-d6c6-41d2-9ba4-19a7d6dd5c1e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.175550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.175550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.175805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.178301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.179218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.179718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.180203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.181209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:44.181696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.184730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.197159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:44.198346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:44.198640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 63/122] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:44.207370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.207717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 60/123] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:44.218746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59ee7-5e5d-4efb-aba7-0fa0eb3b044b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.223967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.225181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.225718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.226272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.227784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.230352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.232431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 64/124] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:44 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:44.235029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.238996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.246463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70b900-be7f-453d-bfc7-0a8264abcb43 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.249902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c777-763e-4f95-91aa-dcfe9ad2c686 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.251615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.252416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.252705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.253014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.254787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.256615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.257201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.258268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 61/125] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:44.258677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.264376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.264535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.265115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] PATH_INFO: `/v3/projects/db98b0858f614767988c57728bae50ba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.267071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] RBAC: Authorizing `identity:get_project(project_id=db98b0858f614767988c57728bae50ba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.269643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.271940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 65/126] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:44 2021] GET /identity/v3/projects/db98b0858f614767988c57728bae50ba => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:44.275030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393eae-0128-4b3e-88e9-5598d2317a38 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.278882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:44.279585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.280241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.280531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.280807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.281595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.283705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d33e45-c448-4183-801a-08dada52cbc2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.290875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25324f-2d7c-4077-b587-354cf85ed295 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:44.296531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:44.297730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:44.298716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:44.299164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] PATH_INFO: `/v3/projects/db98b0858f614767988c57728bae50ba/users/28c4a9e1cf09468db7274b5d516b04b1/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:44.301462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db98b0858f614767988c57728bae50ba, user_id=28c4a9e1cf09468db7274b5d516b04b1, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:44.306973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 62/127] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:40:44 2021] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:44.310100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb763e-6eb4-4380-97f8-ecea47d7b944 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:44.338405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:44 2021] PUT /identity/v3/projects/db98b0858f614767988c57728bae50ba/users/28c4a9e1cf09468db7274b5d516b04b1/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:40:45.900333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b05b-2680-4da9-86e5-16a1b3dbfc0d None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:45.901407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b05b-2680-4da9-86e5-16a1b3dbfc0d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:45.901898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b05b-2680-4da9-86e5-16a1b3dbfc0d None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:45.904288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 63/129] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:45.910212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:45.910683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:45.910773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:45.937297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:45.939026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:46.006368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:46.045954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3b05b-2680-4da9-86e5-16a1b3dbfc0d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.064685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3b05b-2680-4da9-86e5-16a1b3dbfc0d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.072587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.073714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.074200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.074691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.090400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:46.098486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:46.099952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:46.106415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.122107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d944-6185-4204-addb-7c5489046aa9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.133594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.134272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.134556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.134829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.135600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:46.135906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:46.137786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:46.147042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 68/132] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:46.153401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.170310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138f369-021d-45df-9786-4175cfd8bcf9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.180720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.181915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.182416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.182892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.184436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:46.186855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:46.189071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 65/133] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:46.195000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.210240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e734d-3e9b-4813-8d65-e89f5d437bfe admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.221058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.221732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.222016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.222294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.233476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:46.235383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:46.250970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:46.257485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.274467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bb4c7-eaf9-4b83-8f23-00605370f904 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.285311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.286472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.286962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.287441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.289123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:46.291488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a41a24-57dc-434c-a7ce-aad1c9e2bf3c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:46.294939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 66/135] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:46.301674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.322151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbbbc-b423-43e7-a3ce-7b5bbbe5771f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.328668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.329402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.329686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.329963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.330812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:46.331124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:46.333007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f8de5-84ca-4dab-9f4a-64cdecd3d00e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:46.341822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 70/136] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=910660db5a7a400c8e4accdc9a348623 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:46.838472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ad1-fcb4-4dc8-ae51-9cfd1c382a1e None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.839155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ad1-fcb4-4dc8-ae51-9cfd1c382a1e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.839673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72ad1-fcb4-4dc8-ae51-9cfd1c382a1e None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.842050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 67/137] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:46.848410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.849020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.849502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.850119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a7e7-653a-4f5a-991d-6bc3eee3c299 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.850413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a7e7-653a-4f5a-991d-6bc3eee3c299 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.850697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a7e7-653a-4f5a-991d-6bc3eee3c299 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.852702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 68/138] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:46.859941 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.860270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.861144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.872070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:46.874891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:46.884248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:46.893961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:46.895172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:46.908109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:46.912458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.928472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f1e5d-e6f7-458b-a4ec-a0b21bb248a5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.936600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.937680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.938194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.940176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.957498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:46.959034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.965260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:46.966948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 72/141] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:46.974335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:46.976740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e508f2-9686-4961-9c4c-f1f01a708793 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.987657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15a92e-8e70-456b-8704-73f8bb2dbfdf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:46.991842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.993111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.993413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:46.993538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.993957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.994728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:46.995219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:46.995765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:46.996801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:47.002031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.004441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.016696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 73/142] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.022847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.038329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:47.039377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183104-c383-4927-8554-4478c6fc3007 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.045520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.046705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.047242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.047360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:47.048409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.049936 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.052380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.054239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 70/143] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:47.054825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 74/144] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.056886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.061977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.080014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65472-c2d7-4d08-b00c-e1a5651c3136 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.081372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38df-e3df-444a-8549-c3529f7290a9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.090575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.091524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.092849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.093316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.093850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.094337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.094853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.095379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.097541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:47.098987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.102103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.113987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.116153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.120585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 71/145] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.128502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.140403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 75/146] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:47.147240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9ed3-6f79-4287-9c3c-48f119ccb423 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.148419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.159929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.163209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.163706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.164236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.164826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c79abc-5ffc-4efe-9aa5-84bc9217377c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.167932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.175247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.175829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.177594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.179058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.179680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 72/147] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:47.180183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.181860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.184261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.185952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.192417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 76/148] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.199243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.207971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da8025-03f8-471c-b8e7-0b1a7699e5de admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.217318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.218737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.219055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f7a24-79ce-4c9c-8eb4-6c2b81e59111 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.220305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.221209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.229278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.230249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.231320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.231818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.233671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:47.235754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.239324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.240394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.242417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.254934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 77/149] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.264452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 73/150] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:47.271127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.284696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879efcc-4e36-4023-b5f5-54289f5b28c8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.290021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.291303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.291871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.292346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.294118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.296669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077b33c-128f-4496-8674-13c5620ac23a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.300300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 78/151] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:47.310339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:47.321460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ba24-27d6-40a8-ad09-67e576c1aafd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:47.327437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:47.328188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.328476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.329135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.330145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:47.330541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:47.332694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0998675-831f-42ea-b7e5-fa24b0b6d0b1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:47.346230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 74/152] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:47 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=374f47211fa14a49969dec56f6247939 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:47.975762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3000d-9dd9-40a3-8d72-a3f1f8ba3619 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.976314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3000d-9dd9-40a3-8d72-a3f1f8ba3619 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.976314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3000d-9dd9-40a3-8d72-a3f1f8ba3619 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:47.978371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 79/153] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:47.984682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:47.985163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:47.985899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.009117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:48.010324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:48.023167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 75/154] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:48.062457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3000d-9dd9-40a3-8d72-a3f1f8ba3619 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.078590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3000d-9dd9-40a3-8d72-a3f1f8ba3619 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.083064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.083859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.084156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.084440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.101899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:48.109173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:48.110977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 80/155] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:48.117559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.127471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302eb90-41ed-4bc7-8afb-9b670f11d4b7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.136910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.137678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.137967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.138300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.139157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:48.139474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.142151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.152029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 76/156] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.158624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.170820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c984fa-dfc6-436e-a61f-7b3816dfdc49 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.175796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.176695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.177072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.177353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.178826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.181183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.183209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 81/157] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.190347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.201818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf27f-f25d-47cf-b71e-d75b7289eb8a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.207226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.207935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.208220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.208554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.221203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.223176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.238995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 77/158] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:48.245447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.257054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c2267-c8f9-4d78-bb5e-8f5225d0a961 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.263658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.263658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.263658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.263658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] PATH_INFO: `/v3/projects/db98b0858f614767988c57728bae50ba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.268997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] RBAC: Authorizing `identity:get_project(project_id=db98b0858f614767988c57728bae50ba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.268997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2870-c90c-4c57-b8c3-186fa6ddb4bd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.269351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 82/159] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/projects/db98b0858f614767988c57728bae50ba => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.276032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.287427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bfbe-44bb-4f66-8411-bb2b10acd460 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.292189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.292840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.293159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.293494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.294359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=db98b0858f614767988c57728bae50ba, user.id=28c4a9e1cf09468db7274b5d516b04b1) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:48.294668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.296719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130866c-898d-4e96-b44f-bfd9eaaf428e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.308274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 78/160] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/role_assignments?user.id=28c4a9e1cf09468db7274b5d516b04b1&scope.project.id=db98b0858f614767988c57728bae50ba&role.id=910660db5a7a400c8e4accdc9a348623 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.331235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cadca-5036-479d-8a47-942a64df75c6 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.331548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cadca-5036-479d-8a47-942a64df75c6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.331780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cadca-5036-479d-8a47-942a64df75c6 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.333668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 83/161] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:48.340292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.340598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.340850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.361623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:48.362823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:48.372979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:48.400136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cadca-5036-479d-8a47-942a64df75c6 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.419788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cadca-5036-479d-8a47-942a64df75c6 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.429261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.430079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.430353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.430626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.455001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:48.462444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:48.463916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 84/163] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:48.470764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.487125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff917dca-7e03-4e01-8bcd-d856bc89ce91 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.492390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.493419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.493910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.494410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.495706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:48.496401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.503834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.516303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 80/164] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.523071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.536550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2ef3-04f8-48d4-989b-c1191c5ba622 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.545290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.546189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.546473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.546747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.577751 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.580008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.581860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 85/165] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.588203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.600680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325a0f-3a5d-4bbf-931f-43ddf05602a9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.605629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.606511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.607032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.607593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.617644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.619775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.630295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:48.640116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.656257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994500a8-1a00-4db6-b55e-47f22ae7a944 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.661911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.663062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.663549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.664073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.665614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.667992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2b4bd-6fab-4ffb-a7c3-ba5952239177 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.671519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 86/167] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:48.678505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:48.688060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47826c9-34bc-4a3d-8bd0-b91482ddb611 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:48.693071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:48.693990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.694538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.694999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.696063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=ffd3b131dc274730b842a360dce35cfb) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:48.696606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:48.698771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e1853-bef3-42bf-bfc5-c934cec378d4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:48.705374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 82/168] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:48 2021] GET /identity/v3/role_assignments?user.id=ffd3b131dc274730b842a360dce35cfb&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=910660db5a7a400c8e4accdc9a348623 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.405301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa854-6b9f-4c95-b8dc-8f6a08661faf None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.406301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa854-6b9f-4c95-b8dc-8f6a08661faf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.406772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa854-6b9f-4c95-b8dc-8f6a08661faf None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.409679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 87/169] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:49.416424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.416939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.416939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.436369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:49.437625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:49.445633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 83/170] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:49.470908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa854-6b9f-4c95-b8dc-8f6a08661faf None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.483307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa854-6b9f-4c95-b8dc-8f6a08661faf None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.487697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.488479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.488760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.489086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.499819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:49.507105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:49.508325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 88/171] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:49.514735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.524372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269270-6060-4b84-bc60-05a2e0ab4810 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.529916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.530576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.530851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.531125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.531891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:49.532752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.534445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e69822-de7a-482a-a9d0-62be9186584c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.543441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 84/172] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.549822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.553001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beac16-9047-46c4-9e93-373e1a691bc0 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.553298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beac16-9047-46c4-9e93-373e1a691bc0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.553575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beac16-9047-46c4-9e93-373e1a691bc0 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.555370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 85/173] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:49.560592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8ae4-406e-4fa7-8478-475a57eb0c7b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.561713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.562149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.562632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.565141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.565998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.566276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.566549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.567757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.569615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.571416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 89/174] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.577186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.583793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:49.585241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:49.587412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841eaf-5d55-4072-a21d-cf8c00d5ae56 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.592030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.592664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.593023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.593301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.601041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:49.602606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.604482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.614186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:49.620404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.620565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.630215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a58-3934-4e96-85c6-a287fcfd5783 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.630869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a73b-d2ad-4270-8f69-3ef5f2f8d01e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.634816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.635760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.636039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.636260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.636379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.637446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.637684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.638028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.638439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.639879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.642558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 91/177] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.648767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.651812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:49.659014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2e87-7de5-47b7-8b0d-994970b35716 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.659632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:49.666458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 87/178] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:49.667444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.667922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.668139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.668420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.668837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.669722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:49.670091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.671991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.678277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 92/179] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:49.679444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca78a2-19e9-4ee1-8374-feb26b667c5c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.685404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.686386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.686813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.687339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.688876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:49.689427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.691386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.708571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 88/180] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.710310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.723735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db5c5a-2065-4e6d-89c6-c824ca13bd1b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.729079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.730302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.730741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.731237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.732908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.735589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.737885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 93/181] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.747929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.760038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1380e63-2243-4093-be6b-c88b4a482b9f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.765218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.766168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.767245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.767718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.777528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.779786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.791062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 89/182] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:49.798309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.813161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742692a-9037-4722-af52-1e09a4527da7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.818511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.819732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.820174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.820593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.822309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.824814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418864-d7fe-48d1-b9f7-1192687651d4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.826867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 94/183] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.833703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.843181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f339-1f97-41dd-8d70-1d803a6e8067 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.848607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.849326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.849610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.849888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.850752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=ffd3b131dc274730b842a360dce35cfb) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:49.851066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.853014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016f0b-4103-40de-becb-c93aeb2357a9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.865089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 90/184] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/role_assignments?user.id=ffd3b131dc274730b842a360dce35cfb&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=374f47211fa14a49969dec56f6247939 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.876287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ab46-01a8-497d-a471-bdbf323701bb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.876573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ab46-01a8-497d-a471-bdbf323701bb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.876852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ab46-01a8-497d-a471-bdbf323701bb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.879139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 95/185] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:49.885853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.886116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.886395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.906044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:49.907679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:49.915789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 91/186] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:49.941194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ab46-01a8-497d-a471-bdbf323701bb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.954461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ab46-01a8-497d-a471-bdbf323701bb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.959536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.960512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.960795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.961102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.962553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.964503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daedee-0e9e-4705-bc5a-e60846878762 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:49.966507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 96/187] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:49.973822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:49.983809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e49fb-aa3e-4328-a4ea-59b7d1d79b4e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:49.989235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:49.989924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:49.990248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:49.990571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] PATH_INFO: `/v3/groups` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:49.991307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:49.992507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:49.992507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:49.992507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:49.993908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9217e7-0cd6-4da9-807a-ec166bc23976 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:50.011409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 92/188] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Oct 12 16:40:49 2021] POST /identity/v3/groups => generated 229 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:51.036925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483a6a-b52b-41db-8357-a370e5e45da5 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.037482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483a6a-b52b-41db-8357-a370e5e45da5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.037482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483a6a-b52b-41db-8357-a370e5e45da5 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.039574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 97/189] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:51.045558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.045975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.046143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.065402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:51.066636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:51.074866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 93/190] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:51.098793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71483a6a-b52b-41db-8357-a370e5e45da5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:51.110999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71483a6a-b52b-41db-8357-a370e5e45da5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:51.115338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:51.116107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.116382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.116650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.127574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:51.134769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:51.135971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:51.142887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:51.151937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5552480-c7f6-4417-a328-88ab711553b9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:51.156386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:51.157109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.157389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.157659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.158419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:51.158717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:51.160475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:51.169104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 94/192] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:51.175407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:51.185771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6b79-37a7-4674-b208-5dc2c7e1e7a3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:51.190727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:51.191576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.191853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.192119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.193353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:51.195480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:51.197061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:51 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:51.203703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:51.214090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedb208-34ef-4844-82d2-a4a15421a998 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:51.218537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:51.219384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.219702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.219971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.221272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:51.223400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315214f-3771-4175-94ff-0a76bff3a120 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:51.225197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 95/194] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:51 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:51.231382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:51.241114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7677714-885d-4935-9d30-b4c556b1809e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:51.245627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:51.246498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:51.246771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:51.247038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db/users/ffd3b131dc274730b842a360dce35cfb/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:51.249216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4975348f1bb42b791ce15f4573297db, user_id=ffd3b131dc274730b842a360dce35cfb, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:51.252394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac54a0-01ba-4339-b99f-afff06d5a3c8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:51.270020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:51 2021] PUT /identity/v3/projects/d4975348f1bb42b791ce15f4573297db/users/ffd3b131dc274730b842a360dce35cfb/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:40:52.021919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9443a-6044-4fd4-ad6d-265ab29e9958 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.022305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9443a-6044-4fd4-ad6d-265ab29e9958 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.022484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9443a-6044-4fd4-ad6d-265ab29e9958 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.024522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 96/196] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:52.031299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a358-2551-4a7e-93dd-f131030f3f6b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.031981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a358-2551-4a7e-93dd-f131030f3f6b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.032460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a358-2551-4a7e-93dd-f131030f3f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.051008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c980a358-2551-4a7e-93dd-f131030f3f6b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:52.052970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c980a358-2551-4a7e-93dd-f131030f3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:52.110085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 101/197] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:52.134615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9443a-6044-4fd4-ad6d-265ab29e9958 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.149038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9443a-6044-4fd4-ad6d-265ab29e9958 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.153874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.154995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.155505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.157060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.158052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6fba-c8c7-48d2-a095-33218b45f7b3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.158539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6fba-c8c7-48d2-a095-33218b45f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.159003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6fba-c8c7-48d2-a095-33218b45f7b3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.161089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 102/198] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:52.169088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.169661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.170129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.170815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:52.178391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:52.179931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 97/199] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:52.186300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.189628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:52.191026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:52.197776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd4617-5d3a-4383-87b2-f0b15f865381 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.199709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 103/200] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:52.206192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.207113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.207590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.208078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.209070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:52.209570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.211377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.220743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 98/201] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:52.225014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.230085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.236039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374774d-b7bb-4983-95f5-b9227c8aa6ad None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.240993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97616a-9968-44f4-b686-985b52bebbb7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.241585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.242980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.243600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.244166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.245895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.246871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.247248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.247599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.249147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.251643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.259267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 99/202] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:52.261292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.265234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:52.271700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17337-c333-46d1-a8d4-e52ade880b9f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.273619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:52.275435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:52.281537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.282063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.282448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.282732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.283029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.284232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.286451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.288441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 100/204] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:52.293461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db56f4-981c-414f-bd6e-3ed898d73c1c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.294676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.298924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.299860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.300336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.300854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.301865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:52.302499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.304453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.307911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf758b7-5ae8-4b59-921d-ba7983bec4b2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.312909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.314549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.314928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.315353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.317713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4975348f1bb42b791ce15f4573297db, user_id=12c2b7d3088e4259a65e864f8c35d8fd, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.320420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:52.325774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee02f-640c-4163-8188-ecf1e3e6073d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.327010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.344976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081432-3416-4540-be05-09128745bd5c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.345172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:52 2021] PUT /identity/v3/projects/d4975348f1bb42b791ce15f4573297db/users/12c2b7d3088e4259a65e864f8c35d8fd/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:52.388981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3024dbb-e998-420f-abb5-0f6cd2e1ec50 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.389311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3024dbb-e998-420f-abb5-0f6cd2e1ec50 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.389645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3024dbb-e998-420f-abb5-0f6cd2e1ec50 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.391759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 102/207] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:52.398020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.398312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.398574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.415693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.416694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.417030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.417312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.418640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.420828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.423441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 106/208] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:52.424212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:52.426931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:52.429760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.437525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 103/209] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:52.440769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f5bd3-d4ae-4c1f-a408-9522b309d754 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.445495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.446409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.446687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.446961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.448324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.450580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.452638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 107/210] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:52.459124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.469667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.472984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bdd79-ab57-4d22-8250-ad6206c1ed70 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.477616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.478627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.478905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.479178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db/users/ffd3b131dc274730b842a360dce35cfb/roles/374f47211fa14a49969dec56f6247939` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.480537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a334-7d7e-4087-a238-9dd3e7f677c4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.481577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4975348f1bb42b791ce15f4573297db, user_id=ffd3b131dc274730b842a360dce35cfb, role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.484279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabeba2-c4f3-4175-b414-fb7de587f943 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.485924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.486772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.487103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.487483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.488628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.490448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.497490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 108/211] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:40:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:52.498858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:52.507366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 104/212] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:40:52 2021] PUT /identity/v3/projects/d4975348f1bb42b791ce15f4573297db/users/ffd3b131dc274730b842a360dce35cfb/roles/374f47211fa14a49969dec56f6247939 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:52.511164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ed362-4449-4099-a33b-6f05134fc6c6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:52.600246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:52.601342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:52.601878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:52.602383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] PATH_INFO: `/v3/groups` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:52.603157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:52.604200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:52.604200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:52.604200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:52.605448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4906c1-67e2-49a6-aec2-0856eb023f7c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:52.624306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 109/213] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Oct 12 16:40:52 2021] POST /identity/v3/groups => generated 226 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:40:53.641344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45b510-a465-45fd-8cdd-6c25fe0bad43 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.642300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45b510-a465-45fd-8cdd-6c25fe0bad43 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.642781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45b510-a465-45fd-8cdd-6c25fe0bad43 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.644839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 105/214] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:53.651139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730010c-1665-4776-9fee-92041b288255 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.652110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730010c-1665-4776-9fee-92041b288255 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.652577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730010c-1665-4776-9fee-92041b288255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.677308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2730010c-1665-4776-9fee-92041b288255 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:53.678602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2730010c-1665-4776-9fee-92041b288255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:53.692752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 110/215] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:53.734421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45b510-a465-45fd-8cdd-6c25fe0bad43 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.754917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45b510-a465-45fd-8cdd-6c25fe0bad43 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.760766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:53.761875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.762367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.762835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.779204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:53.787059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:53.788293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 106/216] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:53.794733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730010c-1665-4776-9fee-92041b288255 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.810082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730010c-1665-4776-9fee-92041b288255 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.817066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:53.817738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.818010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.818275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.819042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:53.819343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:53.820965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:53.839060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 111/217] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:53.846160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.867297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a18816-d900-4c25-8a8d-38ef47093030 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.872035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:53.872973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.874123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.874461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.880781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:53.883051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:53.884783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 107/218] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:53.891170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.906082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26b7c-39e1-4ae2-9ede-71e0553a296c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.914125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:53.914779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.915056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.915326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.923803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:53.925579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:53.936776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 112/219] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:53.943002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.956426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ce275-b429-4c1a-8be9-aab79abb4058 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.963115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:53.964033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.964317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.964593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.966861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:53.969075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3728cdd-8ff9-422e-bdf9-5857f896fa12 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:53.971470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 108/220] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:53.978248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:53.987657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571675f4-c613-4bf8-9ae0-9ceeebdbbfa0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:53.999677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:54.000342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:54.000643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:54.000930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:54.001801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] RBAC: Adding query filter params (role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=ffd3b131dc274730b842a360dce35cfb) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:54.002108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:54.004324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b0e12-e975-45c0-ab3d-fc355d5310bc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:54.017041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 113/221] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:53 2021] GET /identity/v3/role_assignments?user.id=ffd3b131dc274730b842a360dce35cfb&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=910660db5a7a400c8e4accdc9a348623 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.093830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522bc8a-52f0-46dd-b8f1-80aa7b61d804 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.094929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522bc8a-52f0-46dd-b8f1-80aa7b61d804 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.095410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522bc8a-52f0-46dd-b8f1-80aa7b61d804 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.097434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 109/222] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:55.103636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.104526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.105095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.131001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:55.132535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:55.144760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 114/223] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:55.186508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522bc8a-52f0-46dd-b8f1-80aa7b61d804 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.203803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522bc8a-52f0-46dd-b8f1-80aa7b61d804 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.208639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.209692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.210196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.210679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.222570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:55.234271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:55.236391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 110/224] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:55.242992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.252749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b169-90e5-4b1a-afd1-e5df4f64a9c9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.263294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.264388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.264892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.265446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.267032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:55.267602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.269572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.283460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 115/225] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.289310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.303342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a08e5-2467-4dd1-bd23-52ca337b7482 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.317258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.318674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.319080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.319426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.320802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.322774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.325083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 111/226] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.331745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.341965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e1531-8fb6-4e83-ae61-7609f4526af6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.353061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.353949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.354394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.354826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.369062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.371063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bda6e1-ac00-4a92-958d-2172c26d1412 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.384987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 116/227] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:55.392258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.405347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dfd2b-9665-47bf-9002-fa6319561f12 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.416766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.417779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.418133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.418474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.419801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.421884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.423953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 112/228] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.429756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966740d2-7435-4001-8fe1-41c80b6a094d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.430318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966740d2-7435-4001-8fe1-41c80b6a094d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.430781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966740d2-7435-4001-8fe1-41c80b6a094d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.432754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 117/229] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:55.435472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.439455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca6b7-b9e8-4ad0-b341-6773ea2f0f1a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.439973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca6b7-b9e8-4ad0-b341-6773ea2f0f1a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.440437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca6b7-b9e8-4ad0-b341-6773ea2f0f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.448526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638b5bb-4077-41e8-8d24-92307a7934a9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.458081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.458787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.459066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.459390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.460239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=12c2b7d3088e4259a65e864f8c35d8fd) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:55.460596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.463112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.470951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 113/230] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/role_assignments?user.id=12c2b7d3088e4259a65e864f8c35d8fd&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.472320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-220ca6b7-b9e8-4ad0-b341-6773ea2f0f1a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:55.473774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-220ca6b7-b9e8-4ad0-b341-6773ea2f0f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:55.486264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 118/231] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:55.523397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.537494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22925a9d-e9ef-457d-87b0-854548ffce8c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.543441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.544336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.544621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.544888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.560407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:55.567777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:55.576641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 114/232] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:55.581001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc8f57-e398-4230-86b1-961ffa0d4689 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.581602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc8f57-e398-4230-86b1-961ffa0d4689 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.582071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc8f57-e398-4230-86b1-961ffa0d4689 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.587205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 119/233] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:55.591022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.592152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.592632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.593119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.602017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd81ad-0619-46af-958b-49a3d6d2b6b9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.613294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.613942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.614218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.614489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.616275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:55.616670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.618369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.637279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 115/234] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.638755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:55.640179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:55.650986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.659796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 120/235] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:55.661863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4de474-ab7b-451e-90fd-35433a207bd1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.677864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.678539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.678818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.679089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.687913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.690229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.707544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 116/236] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:55.709525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.714875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.726269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecfa2e-3b43-4211-9dee-a3e0dc729a56 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.730220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf751b2-29ca-45e8-bcbe-a338ba86d494 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.736008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.737165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.737638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.738128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.745765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.746645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.746925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.747198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.748497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.751119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.753412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 117/237] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:55.759901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.766066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:55.774510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:55.781091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 121/238] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:55.783728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f4918-9d94-48e4-b70a-9b4996f815bd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.786063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.796116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.797004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.797288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.797598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.802521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1352c1f-0375-43ad-82ad-886593e18c8b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.814292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.815277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.815399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:55.815399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:40:55.815399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:40:55.816397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.816574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.817080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.817542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.818571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:55.819072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:55.819673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.821499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.825037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.836798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 122/240] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.849219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77d4fa-c119-4b03-9cdb-bfc842a7820b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.853938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.856773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.857466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.857746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.858021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.858883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:55.859192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.861121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.867675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 119/241] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=910660db5a7a400c8e4accdc9a348623 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:55.870909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae74b45-6286-4b48-b8c3-0e88385465d0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.886816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.887951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.888371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.888806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.891018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.893976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.897200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 123/242] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:55.902602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.922555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a604d19-aaee-49a0-a1f6-8c65bad6bb0f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:55.933386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:55.934046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:55.934328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:55.934600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:55.952717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:55.955175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:55.971062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 120/243] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:55.977295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:55.995589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832d5e6-fd6e-42c5-abf8-569efb616436 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.005941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.007158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.007637 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.008099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.010584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.012871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838b44c-79a8-4b4d-9ac1-a29dec997d13 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.015839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 124/244] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:55 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:56.021534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.034227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29ef9-c785-43d5-984a-5ede6717737b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.041474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.042142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.042420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.042695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.043596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=d4975348f1bb42b791ce15f4573297db, user.id=ffd3b131dc274730b842a360dce35cfb) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:56.043910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.050202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec8daa-36b9-4c8f-a043-593cc64434f2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.057417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 121/245] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/role_assignments?user.id=ffd3b131dc274730b842a360dce35cfb&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=374f47211fa14a49969dec56f6247939 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:56.462702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b994c-b651-4589-aa58-16354ea701d4 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.463714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b994c-b651-4589-aa58-16354ea701d4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.464189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b994c-b651-4589-aa58-16354ea701d4 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.466707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 125/246] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:56.473383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.473905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.473905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.498227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:56.499430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:56.511272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 122/247] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:56.550578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b994c-b651-4589-aa58-16354ea701d4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.567197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b994c-b651-4589-aa58-16354ea701d4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.574891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.575975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.576443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.576898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.591500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:56.599805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:56.601487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 126/248] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:56.608002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.621501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf4be8-ce59-49ac-a1c2-ec133f9cd8a5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.629046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.629724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.630003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.630276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.631051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:56.631354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.633099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.645668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 123/249] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:56.651681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.666665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c604-bf21-470c-af27-bc2f99ad9656 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.677200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.678142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.678636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.679121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.693188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.695264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.711152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 127/250] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:56.717134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.734045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f7792-5ba2-45e3-a081-2ac6a070778c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.741040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.741910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.742192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.742466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.746854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.748978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.750822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 124/251] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:56.757653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.769999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2348d-13c6-4285-bd7d-3dece22c987c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.775404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.776687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.777201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.777670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.780133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.781525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:40:56.781525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:40:56.781525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:40:56.783776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a118d-3b88-4682-b076-2641f3da1809 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.785896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 128/252] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:56.793980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:56.806511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2a16-f5cc-43eb-a3e4-7524d320f901 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:56.814587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:56.815637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:56.816111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:56.816626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:56.817889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=374f47211fa14a49969dec56f6247939, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:56.818401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:56.820576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671e254-48da-4421-9d8d-91a02b61bbcb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:56.830141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 125/253] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:40:56 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=374f47211fa14a49969dec56f6247939 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:57.593656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec1d2-c875-45c2-88c7-bf2e3b9ffc22 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.595128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec1d2-c875-45c2-88c7-bf2e3b9ffc22 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.595593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec1d2-c875-45c2-88c7-bf2e3b9ffc22 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.597611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 129/254] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:57.603930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.604820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.605314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.623530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:57.625063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:57.637054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 126/255] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:57.660565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec1d2-c875-45c2-88c7-bf2e3b9ffc22 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.674744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec1d2-c875-45c2-88c7-bf2e3b9ffc22 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.685003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.686042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.686514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.686972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.698960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:57.711076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:57.712516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 130/256] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:57.719182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.732970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b2e7-ca12-4062-a08e-456ac3fbaca1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.741183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.742131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.742603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.743060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.744014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:57.744543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:57.746365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:57.762179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.762823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 127/257] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:57.778073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2f08-a5f8-425c-a23a-c17251080f6e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.789677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.790337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.790616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.790887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.804468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:57.810348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:57.825404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 131/258] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:40:57.832262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.847210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615790f2-4d99-4c56-9f04-a3c381efbc0d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.854838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.855981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.856507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.857016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.860100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:57.862450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:57.864437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 128/259] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:57.870979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.880983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc68e28-91cb-4c70-b9b6-f6fc201e6a4c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.889142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.889998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.890278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.890547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.896740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:57.898787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc01736-fd75-4621-b7e1-be42cf24e376 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:57.900817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 132/260] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:57.907663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:57.918071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe2d3e-ebda-4516-acb1-91312b74bf67 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:57.922820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:57.923690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:57.924202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:57.924675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:57.925765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=d4975348f1bb42b791ce15f4573297db) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:57.926271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:57.928309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f1b55-98cd-4df9-9fc1-7c90062f2154 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:57.934729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 129/261] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:40:57 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=910660db5a7a400c8e4accdc9a348623 => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.473698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd229-a416-4855-90c8-044f8858fab2 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.474051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd229-a416-4855-90c8-044f8858fab2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.474246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd229-a416-4855-90c8-044f8858fab2 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.476039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 133/262] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:58.482380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.482668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.482946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.502043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:58.503498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:58.511880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 130/263] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:58.537656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd229-a416-4855-90c8-044f8858fab2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.551719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd229-a416-4855-90c8-044f8858fab2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.556170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.557059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.557335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.557608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.569415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:58.576816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:58.578086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 134/264] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:58.584517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.593855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e773868-5b2d-474e-86e8-fe6a1f0b68ef None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.599863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.600519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.600797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.601103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.601883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:58.602241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.603901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7c6e-5ac3-4721-a5bb-966781f52432 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.617007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 131/265] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.621714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.638096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec861a-f5a4-41d4-9339-163ed723fa96 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.649211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.650167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.650640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.651107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.665516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.667586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.679863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 135/266] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:58.686430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703281a0-286b-4451-b8b0-067bde0004b9 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.686718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703281a0-286b-4451-b8b0-067bde0004b9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.686994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703281a0-286b-4451-b8b0-067bde0004b9 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.689385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 132/267] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:58.690854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.695843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.696126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.696404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.705868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb645a61-e478-4760-8fa3-5c7306c8767e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.721109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:58.722436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:58.722543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.723411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.723693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.723965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.725650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.727710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.729432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 136/268] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.730875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 133/269] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:58.736836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.747030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368150c-c7b1-4d5e-98ef-c5806a4ef55b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.752298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.753461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.753742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.754016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.755289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.757381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.759112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 137/270] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:58.765498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.776104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ced21-82fb-40ac-902a-c73f02ed3eb3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.777693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.787654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.789896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.790199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.790478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.792982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=374f47211fa14a49969dec56f6247939, scope.project.id=d4975348f1bb42b791ce15f4573297db) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:58.793315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.796342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3caa-f479-4e8c-a88e-a1baf1ba4292 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.798526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.807809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.809143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 134/271] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=374f47211fa14a49969dec56f6247939 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.809815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.810154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.810370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.826319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:58.833781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:40:58.835118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 138/272] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:58.841747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.852699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbe183-114d-44e6-91a1-5f630850953d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.857568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.858314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.858595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.858864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.859708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:58.860592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.862419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.871858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 135/273] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.878817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.890210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b386715-a236-44aa-a62e-2ed0cd878234 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.895025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.895663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.895994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.896271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.905347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.907714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.918053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 139/274] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:58.925330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.935660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b785c-4c0a-4414-ab9c-d0a69b625276 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.941087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.942029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.942311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.942592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.944011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] RBAC: Authorizing `identity:get_project(project_id=f0ea88d5877948298aefb26cf4ba2957)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.946070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.948198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 136/275] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:40:58.954701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.964166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf601-2aa7-462a-b576-1d65a31b6bef admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:58.969191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:58.970165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.970443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.970719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] PATH_INFO: `/v3/groups/c6a5ab94198e4a96ac19645d8874332b` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.977831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] RBAC: Authorizing `identity:get_group(group_id=c6a5ab94198e4a96ac19645d8874332b)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:58.979812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d579-a8b1-487c-8cb4-93b626f293af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:58.981720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 140/276] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/groups/c6a5ab94198e4a96ac19645d8874332b => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:58.989054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.001761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68acc-8166-4031-8b1c-a3571e79b33b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.006778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.007530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.007811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.008083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.009022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] RBAC: Adding query filter params (group.id=c6a5ab94198e4a96ac19645d8874332b, role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=f0ea88d5877948298aefb26cf4ba2957) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:59.009342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.011429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5754ac-9974-49da-b289-b5c6b9550668 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.018081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 137/277] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/role_assignments?group.id=c6a5ab94198e4a96ac19645d8874332b&scope.project.id=f0ea88d5877948298aefb26cf4ba2957&role.id=4fc92071567747e89f2e86ecec30229e => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.440395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b51-6fe0-447b-886f-956884c21c2a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.440779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b51-6fe0-447b-886f-956884c21c2a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.440995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b51-6fe0-447b-886f-956884c21c2a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.442970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 141/278] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:59.449269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.449558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.449835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.473991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:59.475198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:59.483297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 138/279] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:59.522493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124b51-6fe0-447b-886f-956884c21c2a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.538629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124b51-6fe0-447b-886f-956884c21c2a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.543218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.544007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.544282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.544554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.556230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:59.567681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:40:59.568915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 142/280] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:40:59.575546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.585050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55ae11-b18a-43dd-b9a8-fc984e4a8253 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.593692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.594913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.595198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.595470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.596249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:59.596551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.598252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.608357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 139/281] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.615494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.626344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4851-90f4-4884-ba14-581024d84ce9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.633158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.634061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.634338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.634612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.635934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.637925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434467-25e6-4ada-bb55-40cf6162a88b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.639816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 143/282] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.645802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.655920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388818eb-57e2-4924-b031-ab1fe5229c7b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.659990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297a2a-0647-4027-ad57-fc3dd4ef9bfb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.660283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297a2a-0647-4027-ad57-fc3dd4ef9bfb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.660560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297a2a-0647-4027-ad57-fc3dd4ef9bfb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.662725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 144/283] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:40:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:59.665090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.665960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.666240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.666514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.668710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.669075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.669397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.673762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.675875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.677854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 140/284] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.692383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:59.693743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:59.700212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.703135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 145/285] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:59.711287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110488f-725f-4297-9494-512b9ec8912c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.725832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.726726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.727014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.727289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.728918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.736118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37e35b6f6c4f5ab54655361435da7d, group_id=09ec9f7379014d9fb8d0309c10d64b8e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.736118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.740988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42614c1-d0de-4851-bf3e-5176ec61fb89 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.745271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.746219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.746497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.746771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.759129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:40:59.760192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 141/286] 10.222.0.42 () {58 vars in 1463 bytes} [Tue Oct 12 16:40:59 2021] PUT /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:40:59.771997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:40:59.773496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 146/287] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:40:59.790335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.874345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f739c81-9e9b-45fb-b471-4640a91a326d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.879925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.880595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.880880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.881282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.882056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:40:59.882359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.883995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.896441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.902672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.921623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77982-5b91-4956-a307-40c7ae60d0c3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.926286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.927461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.927748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.928021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.929326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.931368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.937411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.943575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.959684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3546-782e-40da-bea8-d3ca861ffd8d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.969400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.970761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.971033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.971306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.973525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.975632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c0950-e29b-4bc6-878e-fdce0e9d19e1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.981063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:59 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:59.983847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:59.999813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2b57-407a-441e-bfff-031ff45c3a6e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:00.010638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:00.011941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:00.012425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:00.012915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/374f47211fa14a49969dec56f6247939` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:00.018416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37e35b6f6c4f5ab54655361435da7d, group_id=09ec9f7379014d9fb8d0309c10d64b8e, role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:00.021465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5305e-defd-4b0d-b8d5-f9af80ea6a31 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:00.042140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 148/291] 10.222.0.42 () {58 vars in 1463 bytes} [Tue Oct 12 16:40:59 2021] PUT /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/374f47211fa14a49969dec56f6247939 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:01.272583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b7cc-a431-4978-b96c-e94d5a9fa537 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.273123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b7cc-a431-4978-b96c-e94d5a9fa537 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.273225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b7cc-a431-4978-b96c-e94d5a9fa537 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.274936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 144/292] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:01.281255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.282211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.282685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.309242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:01.310358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:01.392427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 149/293] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:01.419607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b7cc-a431-4978-b96c-e94d5a9fa537 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.441606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b7cc-a431-4978-b96c-e94d5a9fa537 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.446653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.447672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.448143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.448601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.470607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:01.477964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:41:01.479429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:01.486651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.499013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db4317-dfc3-4dce-b47a-727340d4344c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.509980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.510652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.510930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.511201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.511969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:01.512273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:01.513937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:01.531503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 150/295] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:41:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:01.537834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.550552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b7fdb-db14-47f4-9bcd-e075aed9e25c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.557015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.558180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.558657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.559122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.565733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:01.567934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:01.569847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 146/296] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:01 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:01.576262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.588357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859033-1e5a-4843-b224-87692e954e1b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.598851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.599816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.600212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.600587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.605971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:01.608034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb996b5-c28c-4160-a341-ff3d6729d489 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:01.610418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 151/297] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:01 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:01.616733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.634425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b1df-26ed-4f40-b952-814a7a9148b9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.645296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.646523 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.647023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.647488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.654354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4975348f1bb42b791ce15f4573297db, group_id=09ec9f7379014d9fb8d0309c10d64b8e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:01.657869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ebbe-512b-4ffc-a676-5ac0ef41f841 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:01.680176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1463 bytes} [Tue Oct 12 16:41:01 2021] PUT /identity/v3/projects/d4975348f1bb42b791ce15f4573297db/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:02.022161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec229-046a-4940-8cd1-9146664cd949 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.022496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec229-046a-4940-8cd1-9146664cd949 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.022822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec229-046a-4940-8cd1-9146664cd949 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.024612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 152/299] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:02.031112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b341e-437f-4817-af9f-dd74ea0d9ed3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.032642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b341e-437f-4817-af9f-dd74ea0d9ed3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.033139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b341e-437f-4817-af9f-dd74ea0d9ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.173673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4b6b341e-437f-4817-af9f-dd74ea0d9ed3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:02.175226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4b6b341e-437f-4817-af9f-dd74ea0d9ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:02.247609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 148/300] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:02.268532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee9f-ec1b-469b-b73c-7a0ade0c5ace None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.268827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee9f-ec1b-469b-b73c-7a0ade0c5ace None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.269128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee9f-ec1b-469b-b73c-7a0ade0c5ace None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.270924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 153/301] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:02.277036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.277885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.278351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.295608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975ee9f-ec1b-469b-b73c-7a0ade0c5ace None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.301382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:02.302783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:02.325174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 149/302] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:02.334668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975ee9f-ec1b-469b-b73c-7a0ade0c5ace None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.339471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.340493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.341012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.341475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.351115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.362682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36961a-bbc5-4fd9-98c6-e6d0b39d1231 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.370442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.371515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.373960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.374456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.376103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:02.386466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:41:02.394944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 154/303] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:02.405641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.407655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:02.424367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:02.426011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 150/304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:02.432878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.457887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e64e6-9aea-42f1-8464-effc3bc3b17d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.470796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.471494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.471778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.472053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.472850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:02.475168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.475168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.504620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 151/305] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:02.514171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.539506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13249-dba3-4703-9252-a7431bc673e9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.548909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.549822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.550106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.550384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] PATH_INFO: `/v3/groups/c6a5ab94198e4a96ac19645d8874332b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.552736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] RBAC: Authorizing `identity:get_group(group_id=c6a5ab94198e4a96ac19645d8874332b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.554725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.556675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 152/306] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/groups/c6a5ab94198e4a96ac19645d8874332b => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:02.559070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509450df-d156-41ab-951e-e4256a40109c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.565530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.567224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.567902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.568181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.568456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.569262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:02.569568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.571185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.581082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 155/307] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:02.583478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12989f9a-c727-435b-8406-52fb37593605 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.587111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.598178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7fde7-c57a-4ccd-9848-e36a5afc9f7a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.600751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.601758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.602042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.602426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.602942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.603685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] RBAC: Authorizing `identity:get_project(project_id=f0ea88d5877948298aefb26cf4ba2957)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.603923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.604202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.604528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.605638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.605833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.607334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 153/308] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957 => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:02.608233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.609966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 156/309] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:02.620614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.621201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.632377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e1bc3-6062-401a-aa76-db4698b9bf75 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.636815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73363-5686-4941-88c8-c5692395813f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.637037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.637956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.638234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.638508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957/groups/c6a5ab94198e4a96ac19645d8874332b/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.643158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ea88d5877948298aefb26cf4ba2957, group_id=c6a5ab94198e4a96ac19645d8874332b, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.648003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.649505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9b649-6ff4-4377-a4c4-86323b39662b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.650638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.650964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.651280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.653713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.658720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.661033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 154/310] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:02.667350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:02.678500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 157/311] 10.222.0.42 () {58 vars in 1463 bytes} [Tue Oct 12 16:41:02 2021] PUT /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957/groups/c6a5ab94198e4a96ac19645d8874332b/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:41:02.688325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17df9-3ed2-49f7-86b8-ec61e041aea8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:02.719230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99cbd3-6040-4d88-85d6-479884b1fd7a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.719230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99cbd3-6040-4d88-85d6-479884b1fd7a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.719230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99cbd3-6040-4d88-85d6-479884b1fd7a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.719787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 158/312] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:02.728352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8782-fa96-439a-8c44-450217384224 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.728787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8782-fa96-439a-8c44-450217384224 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.729217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8782-fa96-439a-8c44-450217384224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.770563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e5de8782-fa96-439a-8c44-450217384224 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:02.774782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e5de8782-fa96-439a-8c44-450217384224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:02.788900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:02.790142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:02.790564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:02.790995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/374f47211fa14a49969dec56f6247939` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:02.794987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4975348f1bb42b791ce15f4573297db, group_id=09ec9f7379014d9fb8d0309c10d64b8e, role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:02.801306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:02.835341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 155/313] 10.222.0.42 () {58 vars in 1463 bytes} [Tue Oct 12 16:41:02 2021] PUT /identity/v3/projects/d4975348f1bb42b791ce15f4573297db/groups/09ec9f7379014d9fb8d0309c10d64b8e/roles/374f47211fa14a49969dec56f6247939 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:02.871761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 159/314] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:02.916566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.008603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff2cb-fd4c-42f6-9e73-e948705193ac admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.013593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.014494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.014778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.015058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.028671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:03.036680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:41:03.037974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 156/315] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:03.044700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8782-fa96-439a-8c44-450217384224 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.062378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8782-fa96-439a-8c44-450217384224 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.070688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.071377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.071659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.071933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.072717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:03.073077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.074746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.087861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 160/316] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:03.094763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.107291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39a98-a135-42a7-8640-69ea3e247fee admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.116075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.116668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.117022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.117303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.134720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.136591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f510197-2af3-47ef-b161-78eefe3191da admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.147950 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 157/317] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:03.154275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.166372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df4b6-e88a-42f7-b70e-492427297a59 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.171255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.172398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.172931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.173402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.174844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.177292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.179546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 161/318] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:03.185658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.186394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5a66-7b37-421a-8253-54fd358becd8 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.186855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5a66-7b37-421a-8253-54fd358becd8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.187173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5a66-7b37-421a-8253-54fd358becd8 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.189661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 158/319] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:03.196743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.197055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.197327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.198291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf3df-b43b-42ba-9f87-0c7c083d2ec1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.203251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.204890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.205416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.205941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.207362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.209631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.211537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 162/320] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:03.217332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:03.218438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.218567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:03.229210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671db6e-6fe5-496c-a393-d6404e1ad271 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.233082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 159/321] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:03.236081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.236992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.237493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.237957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.238988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:03.239495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.241555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.248112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 163/322] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=910660db5a7a400c8e4accdc9a348623 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:03.252526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.268936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14286a29-ee1c-4e84-8b03-02b54ea11e54 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.273752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.274627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.274898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.275167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.288066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:03.296008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:41:03.297508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 160/323] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:03.304077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.316655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f183c7-6a7b-4cf4-b024-3f12a344751b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.334656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.335614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.336038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.336506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.337515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:03.337980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.339826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.358554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 164/324] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:03.365820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.376725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c46ba4-1dc8-44b2-81f5-768dce6d1a27 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.389225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.389969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.390253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.390525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.402561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.404401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.422246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 161/325] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:03.429391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.440505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562952c2-b8d8-4493-bad4-d12dec5b4b4d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.445597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.446764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.447280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.447751 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.449267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.451659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.454466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 165/326] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:03.461143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.471014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8b70-afb9-47e9-aa55-6f64ddedd3d5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.475884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.477010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.477489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.477980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.479386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.481557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d874-f619-428d-a202-ef56e98f1e1a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.483727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 162/327] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:03.490648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:03.501889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0bcee-d16a-4989-ba99-29d3de2b80bd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:03.513092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:03.514115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:03.514595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:03.515063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:03.516195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=374f47211fa14a49969dec56f6247939, scope.project.id=8e37e35b6f6c4f5ab54655361435da7d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:03.516735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:03.518835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23861c1f-2359-42fe-8233-356ede0b6be2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:03.526060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 166/328] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:41:03 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=8e37e35b6f6c4f5ab54655361435da7d&role.id=374f47211fa14a49969dec56f6247939 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:04.553803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034b31-45b7-4797-b3e7-8b393849e40b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.554305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034b31-45b7-4797-b3e7-8b393849e40b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.554378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034b31-45b7-4797-b3e7-8b393849e40b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.556099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 163/329] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:04.562076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.563460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.563885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.581727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:04.583311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:04.592125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 167/330] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:04.617269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034b31-45b7-4797-b3e7-8b393849e40b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.629817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034b31-45b7-4797-b3e7-8b393849e40b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.633991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.634766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.635045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.635313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.645323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:04.652222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:41:04.653416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 164/331] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:04.660202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.669063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795775-0260-474a-ae81-1e42f807c5a8 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.674197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.674860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.675133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.675401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.676161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:04.676464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.678072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.686873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 168/332] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:04.692816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.702313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90bc9-fe4b-4897-904e-ddfb45d3e909 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.706588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.707219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.707501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.707776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.715981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.717751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.727055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 165/333] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:04.733026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.743007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3358f1-c95b-4797-8c9b-db2875ca056f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.747249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.748091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.748365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.748631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.749858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.751950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.754054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 169/334] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:04.759985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.769378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d00d-c912-48d6-b8fc-92c4a8ccceb1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.774090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.775195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.775680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.776149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.777556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.779671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f07aa-ea3e-4955-8158-862e9768f9bd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.782041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 166/335] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:04.788415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.798645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894110-7a54-4480-a362-ab550eb82657 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.802907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.803544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.803826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.804097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.804930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=910660db5a7a400c8e4accdc9a348623, scope.project.id=d4975348f1bb42b791ce15f4573297db) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:04.805271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.807091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417532f-ee38-4de2-badb-7108689b4071 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.813185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 170/336] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=910660db5a7a400c8e4accdc9a348623 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.206537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1feab1-5211-4ea9-b9d1-304646fdc49b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.207047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1feab1-5211-4ea9-b9d1-304646fdc49b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.207151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1feab1-5211-4ea9-b9d1-304646fdc49b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.208890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 167/337] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:05.215328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.215622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.215901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.234434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:05.235652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:05.243245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 171/338] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:05.267928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1feab1-5211-4ea9-b9d1-304646fdc49b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.279897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1feab1-5211-4ea9-b9d1-304646fdc49b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.284672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.285479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.285762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.286033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.295965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:05.303046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:05.304205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 168/339] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:05.310787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.321111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3a428-5844-4522-a8b5-f26cc48fe63c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.325852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.326544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.326826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.327101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.327884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:05.328187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.330452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.339860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 172/340] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.347367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.357440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e0ed-fafb-47fa-99ff-a99e7b5acc32 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.361921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.362563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.362847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.363124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.371491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.373255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.382626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:05.388863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.399102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829fbc2-a3ca-41be-816f-7c098145880e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.403523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.404322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.404602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.404874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.406134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] RBAC: Authorizing `identity:get_project(project_id=f0ea88d5877948298aefb26cf4ba2957)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.407943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.409641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 173/342] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.416227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.425758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084468e2-ef68-4e5e-8f41-c970fa1cb6cb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.430296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.431141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.431417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.431687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] PATH_INFO: `/v3/groups/c6a5ab94198e4a96ac19645d8874332b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.432880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] RBAC: Authorizing `identity:get_group(group_id=c6a5ab94198e4a96ac19645d8874332b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.434808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb0a0-2404-4488-adce-ac00c03bd246 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.436409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 170/343] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/groups/c6a5ab94198e4a96ac19645d8874332b => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.443384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.453032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aba12-7865-4998-8519-7f7e9c5390bc admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.459335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.459922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.460202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.460601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.461444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] RBAC: Adding query filter params (group.id=c6a5ab94198e4a96ac19645d8874332b, role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=f0ea88d5877948298aefb26cf4ba2957) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:05.461765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.463597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.466814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7449-9ed1-4a6c-8467-3adab8fb828e None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.467096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7449-9ed1-4a6c-8467-3adab8fb828e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.467371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d7449-9ed1-4a6c-8467-3adab8fb828e None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.469226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 171/344] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:05.480972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 174/345] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/role_assignments?group.id=c6a5ab94198e4a96ac19645d8874332b&scope.project.id=f0ea88d5877948298aefb26cf4ba2957&role.id=4fc92071567747e89f2e86ecec30229e => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.481192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.481192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.481192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.494700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:05.495930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:05.504907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 172/346] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:05.530642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.540731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30272-a1b6-4c5a-9889-ab5d8a7f8594 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.545351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.546169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.546451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.546732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.558149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:05.566409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:41:05.567667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 175/347] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:05.574217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.584247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932385a5-28dd-42c0-87a5-6c6d5f06463d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.589759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.590440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.590729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.591002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.591809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:05.592118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.593809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.603095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 173/348] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.609513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.620279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104920-5c7a-4331-8f4c-c56b0230529d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.624813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.626010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.626291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.626564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.635433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.637244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.647406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 176/349] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:05.653975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.664055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b545c85-126a-4ddf-b27c-327689dfa4c2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.668508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.669391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.669700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.669956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.671164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.673263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.674948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 174/350] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.681112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.690541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4fa8-291f-4f0f-8c8a-7c51f430d352 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.695236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147796c-619e-4570-b079-f09588ffface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.696094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147796c-619e-4570-b079-f09588ffface admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.696377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147796c-619e-4570-b079-f09588ffface admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.696650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147796c-619e-4570-b079-f09588ffface admin admin] PATH_INFO: `/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.697913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147796c-619e-4570-b079-f09588ffface admin admin] RBAC: Authorizing `identity:get_group(group_id=09ec9f7379014d9fb8d0309c10d64b8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.699809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147796c-619e-4570-b079-f09588ffface admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.701454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 177/351] 10.222.0.42 () {56 vars in 1201 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/groups/09ec9f7379014d9fb8d0309c10d64b8e => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:05.708557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:05.718492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b3a4-6b57-4e71-a6c5-5d7ae1c810c5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:05.722796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:05.723426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:05.723705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:05.723975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:05.724816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] RBAC: Adding query filter params (group.id=09ec9f7379014d9fb8d0309c10d64b8e, role.id=374f47211fa14a49969dec56f6247939, scope.project.id=d4975348f1bb42b791ce15f4573297db) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:05.725182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:05.727054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f63391-05b8-4dce-97ca-86367bf35528 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:05.732927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 175/352] 10.222.0.42 () {56 vars in 1397 bytes} [Tue Oct 12 16:41:05 2021] GET /identity/v3/role_assignments?group.id=09ec9f7379014d9fb8d0309c10d64b8e&scope.project.id=d4975348f1bb42b791ce15f4573297db&role.id=374f47211fa14a49969dec56f6247939 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:08.650064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370409-48e5-4545-a669-42b89edad734 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.651101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370409-48e5-4545-a669-42b89edad734 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.651594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370409-48e5-4545-a669-42b89edad734 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.654054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 178/353] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:08.662061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499992fb-e0a3-41d4-a744-c87201d0cbd0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.662563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499992fb-e0a3-41d4-a744-c87201d0cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.662665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499992fb-e0a3-41d4-a744-c87201d0cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.693354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-499992fb-e0a3-41d4-a744-c87201d0cbd0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:08.694587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-499992fb-e0a3-41d4-a744-c87201d0cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:08.702734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 176/354] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:08.731805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86370409-48e5-4545-a669-42b89edad734 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:08.748254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86370409-48e5-4545-a669-42b89edad734 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:08.755254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:08.756320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.756803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.757327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.774034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:08.776207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:08.802278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:08.804124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 179/355] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:08.808932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a8c1-d23c-421b-a1ef-11d53a893e7a None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.809247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a8c1-d23c-421b-a1ef-11d53a893e7a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.809527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a8c1-d23c-421b-a1ef-11d53a893e7a None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.811266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:08.813767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 177/356] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:08.818958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.819249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.819526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.824630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005bb1-4bc5-4580-9ff6-2c05885f52e9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:08.839593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:08.840273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.840555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.840831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.841206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:08.841608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:08.841915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:08.843057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:08.843514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:08.852845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 178/357] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:08.866773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 180/358] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:08.872716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:08.887369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a14d4-ead8-4919-88c1-12e164fc1d1d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:08.888283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:08.894557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:08.895520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.896009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.896500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.897467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:08.900472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:08.903416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cffc-76f0-49e4-82f6-996bff1bf4e7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:08.914641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:08.915862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:08.916381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:08.916937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:08.927565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 179/359] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:08 2021] POST /identity/v3/users => generated 246 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:08.938057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:08.939996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:08.964810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:08.966530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 181/360] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:08.973471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:08.986731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de657-e81f-4944-aaf7-f39cd4ffceae admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:08.998762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:08.999888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.001101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.001596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.002565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:09.003337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.004546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:09.004546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:09.004546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:09.005782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246ad41-9b7a-4c11-88a3-4c6857f8dc7f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.031524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 180/361] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:09.037754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.053972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8af39-7349-4571-9afc-d903364415e9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.062075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.063323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.063610 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.063883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.064631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.065701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:09.065701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:09.065701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:09.067043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640131dd-43eb-49db-841b-118c59560381 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.106364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 182/362] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/users => generated 248 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:09.582722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956ab7-136d-40a3-a6f7-4a9faecc942d None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.583370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956ab7-136d-40a3-a6f7-4a9faecc942d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.583860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956ab7-136d-40a3-a6f7-4a9faecc942d None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.586146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 181/363] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:09.592980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.593269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.593545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.621689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:09.623455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:09.636657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 183/364] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:09.662417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956ab7-136d-40a3-a6f7-4a9faecc942d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.681694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956ab7-136d-40a3-a6f7-4a9faecc942d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.687163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.688540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.688834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.689160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.706006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.707910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.735934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:09.741050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 182/365] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:09.743733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.757235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878022ba-ddd8-44dd-9b18-d6c8d47f1ba4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.770480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.771141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.771422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.771696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.772436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:09.772738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.774388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad805b0-6db7-4818-b46f-80e4a09d8e66 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.796349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 184/366] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:09.802816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.811384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147ebd-3ec5-4116-9fc7-3e337d89f016 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.811671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147ebd-3ec5-4116-9fc7-3e337d89f016 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.811946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147ebd-3ec5-4116-9fc7-3e337d89f016 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.816361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d3a50-dbb4-449d-9ac3-5529e570ba04 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.817026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 185/367] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:09 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:09.822047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.822709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.822988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.823259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.823994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.826250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.826424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df3c20-38dc-4423-990a-b61d81e93900 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.826530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.826800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.851262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:09.851991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 183/368] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/users => generated 248 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:09.852450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:09.853535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0497d-b07a-4945-8f78-99a5dc6cd0e7 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.853819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0497d-b07a-4945-8f78-99a5dc6cd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.854142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0497d-b07a-4945-8f78-99a5dc6cd0e7 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.856240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 184/369] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:09.862809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.863094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.863369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.866784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 186/370] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:09.894689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:09.895668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.896469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:09.905714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3e40c-0ff1-47a2-a5ad-ec7534a6e383 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.910466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 185/371] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:09.911750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.911750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.911750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.912081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.924749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.927089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.946664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:09.948256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 187/372] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:09.955513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.958715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.974528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a78fc-4889-4f89-a92f-cd7fb579028a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.977711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4d3c2-28a5-42d6-b8f0-f78348e55db1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.985885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.986573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.986849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.987125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.987883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:09.988190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.989883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.992514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.993843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.994349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.994845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.996332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.999540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:10.009606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.sql.core [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 16:41:10.009606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 16:41:10.009606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [parameters: {'id': '68699754c9654224a7584073c713f5a3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 16:41:10.009606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73567) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:41:10.013594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 186/373] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:10.022052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:10.031390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 16:41:10.038558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 188/374] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/roles => generated 144 bytes in 75 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:10.040061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:10.040713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546fe3-5b66-477d-9bd2-ef5962be921d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:10.053667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:10.054359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:10.054641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:10.054966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:10.056757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:10.061930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:10.065074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e3a79-4818-497e-bfe3-a824076a2e5e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:10.076832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:10.077775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:10.078054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:10.078366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:10.093259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:10.102582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 187/375] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:10 2021] POST /identity/v3/users => generated 249 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:10.108857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-ff97cce7-17dc-4eab-b1cb-70a9d5d19b0c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:41:10.111225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 189/376] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:10.117853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:10.135771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb48502-e216-4a2f-a1e3-5e86074a18d5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:10.144134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:10.144829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:10.145137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:10.145460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:10.146238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:10.146613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:10.148606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41328cc1-fb13-4720-a82e-471de1d97ec8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:10.161194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 188/377] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.101567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90998-bc55-4ac0-ad15-06407c3e9dc1 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.102077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90998-bc55-4ac0-ad15-06407c3e9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.102183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a90998-bc55-4ac0-ad15-06407c3e9dc1 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.104175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 190/378] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:12.107428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e11e-a79e-4d57-9973-2e6522bdb0e5 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.107845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e11e-a79e-4d57-9973-2e6522bdb0e5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.108035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e11e-a79e-4d57-9973-2e6522bdb0e5 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.111560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.111847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.112124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.113528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 189/379] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:12.117045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.117338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.117613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.145973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:12.147177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:12.148257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:12.149461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:12.163618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 190/380] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:12.163899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 191/381] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:12.186879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.196579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c46b28-f287-4f36-b66e-ac74c047d7f9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.200074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.203159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.204564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.204847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.205159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.210083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37940437-352c-4840-8485-90ca05ed6e3c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.214914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.215945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.216426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.216915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.225849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:12.228552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:12.232887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:12.234444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 191/382] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.236432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:12.238207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 192/383] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.240589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.245200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.256780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db8246-1efb-4456-bd7d-f9f830d443f0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.258168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df511f9-f074-4e21-9b0d-c2467f22e0fe admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.268180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.269022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.269439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.269690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.269967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.270235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.270553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.271007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.271234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.271331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.272287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.272787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.272887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.274959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.284767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 193/384] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:12.295150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.295287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 192/385] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.301071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.313170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e935d-2aa6-4382-b96d-2d16ab54cdbf admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.313404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde9515-649f-456e-8909-6c5ff671aae9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.320515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.321338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.321613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.321886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.323434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.324211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.324482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.324745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.344678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.346162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.346562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.348018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.364724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:12.366186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 193/386] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.374007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.375847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:12.377081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 194/387] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.383369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.387179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85741a73-b5a6-428e-8ff5-7a7271daeb70 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.393493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc9e04-10c8-45cd-8a10-e4c691eb4f00 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.399679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.400342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.400621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.400891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.401656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.401955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.403564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.407731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.408396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.408668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.408935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.409685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.409983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.411613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.424982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 194/388] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.430781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.435973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 195/389] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.441827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2c36a-0317-4831-b374-9f07eeaa8b21 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.442106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.447062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.448088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.448560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.449061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.452762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2db1-59d7-443e-87d5-0c5db8bfbe2a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.458362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.460595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.468287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.469150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.469434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.469708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.475976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:41:12.477767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 195/390] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.478055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.480089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.487360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.507593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673f55-64c0-4527-a594-bbcbef2fcc43 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.515533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:12.517440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.517606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 196/391] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:12.518502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.518982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.519442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.520494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.521021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.522242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:12.522242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:12.522242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:12.523725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.524778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.540970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828ce56-ca5a-495e-a99f-93b05e3476d1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.540970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.540970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.540970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.541346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.541896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.542198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.543252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:12.543252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:12.543252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:12.544389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.586013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 197/392] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.592585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.602929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 196/393] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.613974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.614140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398fcc9-db4b-4eeb-a8c6-b532de4ce339 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.618735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.619428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.619710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.619985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.629580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde4d13-f962-4ce5-8955-697fc8c18447 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.635708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.638012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.641404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.642081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.642367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.642636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.658127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.658868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 198/394] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:12.660380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.663316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.677560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed7137-6a2b-4aa3-9d5a-6097f401aaa9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.685691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 197/395] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:12.690277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.691150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.691490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.691762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.694543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.705834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a5b1b-af8c-46e7-9f35-42372694bb12 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.717748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.718656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.718977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.719247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.721079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.725267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.734257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.736707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.757325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:12.758874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 198/396] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:12.761264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:12.762820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 199/397] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:12.768985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.770241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.776191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d9871-6f36-494c-bab1-8e5a1e8ae5d3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.782195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.782926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.783206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.783477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.784287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.784592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.785333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd7d8-7cbc-4d8c-8fcf-aa741b1a80a5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.786320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.798556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.799313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.799592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.799864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.802301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.804382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.806639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.812025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.823657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.836528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aac266-e5d6-48c1-91a8-f5350c5a140e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.837819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 200/399] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.840208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.846009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.846857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.847135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.847408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.859179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721933-4b7d-4d84-8db4-18605bb9521f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.863742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.866261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.872245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.873084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.873364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.873644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.889760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.892314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.893934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-4aed3fd4-266a-43ff-8c05-b2199a5d8f25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:12.895498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.896914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9249a-1ebb-48ba-af12-823df522b7c8 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.897435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9249a-1ebb-48ba-af12-823df522b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.897961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9249a-1ebb-48ba-af12-823df522b7c8 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.899843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 201/401] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:12.906000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.906621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.907220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.912216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:12.913777 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 201/402] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:12.914625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.924381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50531e13-ee57-4ff5-a8a0-849c7c74cb3e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.928825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.929502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.929782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.930053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.930843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.930937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:12.931175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.932104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:12.932197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:12.932197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:12.932197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:12.933325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eae19-68f2-4df1-9094-96bb63932ee3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.945025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 202/403] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:12.945025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.952486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 202/404] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.957016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d842a7-2efa-4aff-90cf-3a22ce979b42 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.958584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe760-757a-45d6-bbe3-37585b546f26 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.959074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe760-757a-45d6-bbe3-37585b546f26 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.959521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe760-757a-45d6-bbe3-37585b546f26 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.960236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.960878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.961183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.961497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.962166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 203/405] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:12.964303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.964303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.964303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:12.964303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:12.964303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:12.965279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749a4b-528e-44f2-ad51-fd8dfc8c8144 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.965759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe760-757a-45d6-bbe3-37585b546f26 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.979397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe760-757a-45d6-bbe3-37585b546f26 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.983843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.984161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 203/406] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.985293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.985467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.986276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.986380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.986380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.986524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e5854e1cb2f34a049f72909a002dde73) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:12.986590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.986920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.988791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.994758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 204/407] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/role_assignments?user.id=e5854e1cb2f34a049f72909a002dde73&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:12.997889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.005783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:13.007229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:13.011382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d9ea6-a91b-4e54-a16c-3d133052be7c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.016786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 204/408] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:13.023299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.024170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.030354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.030926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.031350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.039667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633a59a-57c7-4094-8375-b0e1edaf0f7c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.046178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:13.053627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.054474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.054856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.055228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.055375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:13.056398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.056936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.057685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 205/409] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.064613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.064823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.069762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 205/410] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.070741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.077349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d6aa-db87-4dd6-91fc-122d6f5e800a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.085115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d441b4-e35d-4af0-88a6-2145fb3cab23 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.092276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.093232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.094342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.095122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.095497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.095881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.096240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.096612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.098198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.100236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.102100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.118912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 206/411] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.126810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:13.128735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.135839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:13.137397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 206/412] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.149366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.152399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28945-c3f0-4253-9cab-a4fae46482d0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.167336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.168463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.169986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.170464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.170799 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a542-f529-4586-9de4-065a38b51ad5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.179646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.180628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.181131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.181594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.182445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.182755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.184464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5473-818a-4af5-ba46-75442053fcd5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.186391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.189135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.197529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 207/413] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:13.198921 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be157c-585c-41a2-a411-4c9c74e623fc None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.199208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be157c-585c-41a2-a411-4c9c74e623fc None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.199487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be157c-585c-41a2-a411-4c9c74e623fc None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.201593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 208/414] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:13.211925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c1aafd50-583f-4f48-bf05-0e900d6bfcd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:13.213751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 207/415] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.214230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be157c-585c-41a2-a411-4c9c74e623fc None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.215384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.215768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.216142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.228995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be157c-585c-41a2-a411-4c9c74e623fc None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.234031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.235746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.236176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.236618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.242198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:13.243606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:13.249326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.251703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.253872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 208/416] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:13.259355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.266243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcb33a-b86a-4d27-82d3-59b1da3c8b30 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.272514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.273320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.273608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.273941 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.274700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.275069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.276905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.291849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 209/417] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.297198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:13.298107 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.303949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 209/418] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.306996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.309754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cc11-584c-403e-9f78-3f1f75ab3cab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.314889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.315731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.316046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.316895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.320290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e41c0-04bc-45a1-8fc7-86439ec1eb64 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.325300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.326085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.326384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.326635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.327863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.333070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.341009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.342853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.345639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:41:13.347121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 210/419] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:13.347837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.365841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f92eb-6889-480a-813f-13d2e5cdf3af admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.369426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:13.370605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.370909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 210/420] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.371681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.371788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.372814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.373159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.375190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.375510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.380506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.386184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039626-e3a8-4750-95d4-cd6dc6506d4c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.392519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.393565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.394155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.394627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.394799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 211/421] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.395609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.396179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.396736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.398968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.405200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f07a6b-f92f-47cb-b457-5d07ab18bb8c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.410684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.411184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.411471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.411749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.412492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.412802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.414564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.421861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 211/422] 10.222.0.42 () {56 vars in 1160 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.423062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.431959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 212/423] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.433293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.444601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1447d9b-51bc-48aa-ad94-7760bb2c0a05 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.447660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a60d7-0e49-4334-877b-9bd2d547c370 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.450006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.451139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.451658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.452130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.452421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.453074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.453894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.454179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.462408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.462784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.464571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.465319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.479970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 213/424] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:13.480841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.481539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:41:13.483238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 212/425] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.484229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.491085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4019-460b-44de-ae9e-4da6e3d83ff9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.495328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e969-87bf-498c-810d-37bbc704c9fe admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.495587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.496255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.496541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.496820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.497771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.500148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.502311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.503643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.504125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.504593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.516471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.518874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.522724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 214/426] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:13 2021] POST /identity/v3/users => generated 247 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:13.528974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.534514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cf516-7183-4f32-93e2-06d04a5b7aa7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.540102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.540834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.541170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.541487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.542416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.542726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.544774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.555725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:13.557544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 213/427] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.566312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.572614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 215/428] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.579109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.591486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b2b2-635e-4181-b238-8d7831453448 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.599109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c173b9-f711-4af1-848c-45df178a3bd7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.604733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.605703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.606132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.606617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.608985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.609572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.613701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.614601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.616163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.616630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.617789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.637551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.642113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.644338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 214/429] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:13.648772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.660723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 216/430] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:13.664588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d625f7c-53e7-4b24-8d88-746b9804edd8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.667468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.678434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.679515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.680178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.681318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.683989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494e63-03ea-48d4-8c98-79e18a3006d2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.696728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.697906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.698387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.698802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.699456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.702227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.725858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.728008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.735323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:13.740707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 215/431] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:13.750506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.757836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:13.759594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 217/432] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.766349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.772088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a592-9dc5-4b9d-ab32-b36ce16c7fad admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.776350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13b44-4f32-4e3a-93d5-25b06f0fce74 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.782509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.783361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.783641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.783914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.784220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.784659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.784876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.784989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.785201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.785450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.786248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.786555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.786647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.788407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.807193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 216/433] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.807377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 218/434] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:13.813472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.813605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.823806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37112-efe3-4486-80f6-d7ee0c30ecd5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.824575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8acf2-bcd9-4046-997e-ccdece752d4e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.828752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.829452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.829559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.829764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.829999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.830279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.830559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.830836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=aa9eafe94021438cbcdae8466277f9d5) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.830942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.831147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.833023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.838934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 217/435] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/role_assignments?user.id=aa9eafe94021438cbcdae8466277f9d5&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.839264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.841353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.858559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:13.860863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 219/436] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:13.867505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.883306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2710d-a411-4995-bcb7-553d34fb4e1f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.888288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.888939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.889308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.889627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.890441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.890795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.892744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d3ca-7068-4013-80e3-46beac4e2fb3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.907187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 218/437] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:13.913634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:13.924855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d2f0-40be-4235-b76e-64a9817d6dc0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:13.930690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:13.931588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:13.932011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:13.932422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:13.933467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=1052f3aba4c24b1aab7ec4ddf46cf820) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:13.933947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:13.935986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba059cb4-4345-4053-a911-208871abdbf3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:13.945114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 220/438] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:13 2021] GET /identity/v3/role_assignments?user.id=1052f3aba4c24b1aab7ec4ddf46cf820&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:15.749394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12490e-e35a-49a7-8628-378e87d7b80d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.750027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12490e-e35a-49a7-8628-378e87d7b80d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.750027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12490e-e35a-49a7-8628-378e87d7b80d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.754061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589a23e-0ca1-417c-b251-e16bdcb0fcc2 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.754466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589a23e-0ca1-417c-b251-e16bdcb0fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.754666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589a23e-0ca1-417c-b251-e16bdcb0fcc2 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.756481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 221/439] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:15.756604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 219/440] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:15 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:15.762333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.762610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.762879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.766894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.767427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.767910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.787031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:15.788594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:15.790634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:15.792028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:15.803177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 222/441] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:15.813666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 220/442] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:15.827410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:15.836609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e0f2e-525a-4f72-abbf-b907c64b841e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:15.845291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:15.846093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.846370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.846643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.860714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:15.867809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:15.869232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 223/443] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:15.874450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:15.880834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:15.891439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783aabf-05fe-4faa-b024-c246ddca8d4c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:15.899323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ad3d2-496a-4f17-b179-ae9ce83ebc1f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:15.901085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:15.901991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.902288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.902545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.906927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:15.907578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.907854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.908128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.908894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:15.909220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:15.910820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:15.925127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:15.932123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:15.933359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 221/444] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:15.939280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 224/445] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:15.942294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:15.945796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:15.958999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ec968-aa4a-4f79-a44a-2b83c208168b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:15.962717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be575d-4658-4f0b-bd17-1d51e2284e79 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:15.967844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:15.969158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.969492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.969771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.974125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:15.974787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:15.975068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:15.975344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:15.976111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:15.976415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:15.978066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:15.992699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:15.994591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:15.999386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 222/446] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.005155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.018747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:16.020236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 225/447] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:16.022441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08509b3-991b-4d44-9cf7-ba146c62dfb0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.030569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.034125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.035181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.035679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.036182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.041344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5443e-8664-4eab-8aa9-ea8b048dbc0f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.052055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.054283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.056066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.057236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.057744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.058262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.059672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.060237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.063385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.078379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 226/448] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.082417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:16.088966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.090627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 223/449] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.095389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598fe81-990c-49bd-9347-6f9d11e5806f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.098131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.100210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.101087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.101347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.101620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.110504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.112532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.115209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb7c96-681b-4255-85fe-e560f2633f17 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.124679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.126193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.126690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.127165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.127722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:41:16.128578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.129116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.132973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 227/450] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:16.134876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.135524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.146166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53771e-3db6-4ef3-b782-efb821b5bad6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.156306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.156990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.157270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.157544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.158394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.158705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.160845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.161072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 224/451] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:16.161945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.179678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 228/452] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.183319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e59a9d-357f-4aad-9ca5-7eba84b2f675 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.185709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.196333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad9ad-0138-4c5f-a02f-41656780b8aa admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.198031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.198834 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.199117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.199390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.201821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.202818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.203849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.204385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.212015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.215781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.217838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.222139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.236642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:16.237059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:16.238054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 225/453] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.239161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 229/454] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:16.244631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.245511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.256889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe3d30-5936-47cf-8ba9-7d2477487701 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.259071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dbb35-a597-4a16-9f60-8c1c8700790a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.267979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.268974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.269508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.270074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.271137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.271590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.273400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.277660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.278346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.278626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.278894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.279748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.280057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.282529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.292994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 230/455] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:16.295336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.312018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ff6a6-2e2f-4834-9ae2-996289438d43 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.322489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 226/456] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.326397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.327451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.327898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.328856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.330713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.344750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.348010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.350566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ffa5-1418-4dbc-8830-29083eaf1044 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.358053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.359124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.363491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.363942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.380185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:16.382413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 231/457] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:16.388647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.391984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.392492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.409693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c46e2-0384-4467-883d-a82bf3ac5e0b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.421626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:16.425603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.426442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.426874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.427308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.428282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.428747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.430764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8749a-6ad6-4641-8925-9a075f3e459e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.432093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 227/458] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.438611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.453542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 232/459] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.460297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831b0f-b29c-4d14-8572-bbb9a3aba67b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.460427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25cd-0418-4dc9-9727-1dffc543d67b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.460986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831b0f-b29c-4d14-8572-bbb9a3aba67b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.461428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831b0f-b29c-4d14-8572-bbb9a3aba67b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.463844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 233/460] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:16 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:16.464613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.465055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831b0f-b29c-4d14-8572-bbb9a3aba67b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.465609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.466037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.466400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.467270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.467756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.470522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5c66-23f1-4b68-a900-58b33f75421d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.479281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831b0f-b29c-4d14-8572-bbb9a3aba67b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.484244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.485538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.485962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.486385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e5854e1cb2f34a049f72909a002dde73/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.490756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 228/461] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.492644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.493133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.493508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.509950 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=e5854e1cb2f34a049f72909a002dde73, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.512904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.517831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:16.519630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:16.529657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 229/462] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:16.530797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.530996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 234/463] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:16 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e5854e1cb2f34a049f72909a002dde73/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:16.542060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a95cd-9507-4eec-b268-712f91f1cd54 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.574114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.650475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.651545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.651924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.652300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.660160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.662453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.676974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-41b1ece0-d2bb-4890-a7a6-d47adc9a965d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:16.680717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c42878-9983-4ec1-aab4-d881ffb52816 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.684175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 230/464] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.686110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b631-716c-4592-a282-25594a969bcb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.686501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b631-716c-4592-a282-25594a969bcb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.686995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b631-716c-4592-a282-25594a969bcb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.689469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.690484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.690910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 231/465] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:16.691034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.691431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.692049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10b631-716c-4592-a282-25594a969bcb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.704256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:16.706767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10b631-716c-4592-a282-25594a969bcb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.711835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.712331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-83ec50a5-c216-451f-ac54-6ba39b9ce266 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:16.712757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.713213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.713587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.714320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 235/466] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:16.714811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.715222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.716195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.716684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.717127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.723409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.743985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 232/467] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.743985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.746064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:16.747509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:16.756531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 236/468] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:16.758032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.763345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504d5bd-f3c6-4b22-b1bc-052f7f76645f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.768060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a4993-eb3f-4fbb-a2fa-ca646fdde9ac None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.769574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.770674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.771192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.771824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.772913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.773032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.773614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.774040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.774390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.774729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.776641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.787252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 233/469] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.792133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.793836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=d0942cb70c474b06a9ea51db2f3298c0, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.796517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.807352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d305d6-36e3-47cd-b059-2c5ccc6a27c4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.814073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 237/470] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:16 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:16.815144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.881609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.882455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.882780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.883055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.894692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:16.901333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffeb4b-fa36-4e94-a897-705577f5205e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.902362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:16.903673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.916788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.926505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.927471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.927813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.928148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.938615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681686-9f1f-401f-b031-5b0d10d943b8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:16.944970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.949891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.951021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:16.951737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.952012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.952279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.953215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:16.954241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:16.958016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c603ba-0d76-40ee-a63a-f503d488f598 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:16.973680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 235/472] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:16.982390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2be8-eb97-410d-8d26-e14d78804a58 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.982897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2be8-eb97-410d-8d26-e14d78804a58 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.983185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2be8-eb97-410d-8d26-e14d78804a58 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:16.985525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-da5df609-72d6-4f07-9741-8f4ab73232d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:16.985917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 236/473] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:16.986927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 238/474] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:16.987062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2be8-eb97-410d-8d26-e14d78804a58 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:16.998529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:16.998939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:16.999111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.000704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2be8-eb97-410d-8d26-e14d78804a58 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.005500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.006296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.006576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.006876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.018658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.020421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.028816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:17.031108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:17.040221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 239/475] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:17.040652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:17.041830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.042391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 237/476] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.052979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.067586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ef0a-d935-4a56-8099-e09c926afdd4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.068929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d94ec-57e5-466d-8555-018574865f48 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.075307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.075670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.075978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.076264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.076376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.076528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.076615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.076847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.077307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.077616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.077711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.077914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.079834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.080005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.091903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 240/477] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.092736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.093668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 238/478] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:17.098937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.107177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f29f8-83c4-44b5-9983-fa7e227bf759 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.110722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660056-387a-4075-adc3-a7aeb21bc8cb admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.111805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.112589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.112873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.113193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.116452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.117267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.117544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.117813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.126253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.127882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:17.128522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.135255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:17.136453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 241/479] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.137228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.142700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:17.144081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 239/480] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:17.148413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.151040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554bdf3-794b-4ea3-833a-d2ba74654c41 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.155522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.156853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.157174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.157439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.158649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2418d-beb2-42c6-869f-2c60ec3615d6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.163754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.164691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.164995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.165277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.165505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.166038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.166344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.167688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.167922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.177311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 240/481] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:17.178118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.182102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:41:17.183284 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 242/482] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.189080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.193172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb81d-607b-43cc-a681-e5efa30b4e59 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.198979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.199543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b7692-4a19-41c1-9ca7-c343cd6845aa admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.199734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.199946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.200279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.201274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.201581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.204231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.204753 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.205587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.205924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.206118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.218005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.220490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.224526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 241/483] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.225400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.237208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8bd8f-5040-4e81-b19f-804b3da5f6e3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.237638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:17.238999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 243/484] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.239802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.248163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.248828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.249164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.249441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.249606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904b0d-271d-42ce-9b17-3cedaa8418c1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.250329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.250645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.252492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.255196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.256036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.256318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.256586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.265473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.267777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.277358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 244/485] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:17.278202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.280314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 242/486] 10.222.0.42 () {56 vars in 1160 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.288042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.292878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e498-fa97-442d-b50c-7c4565be9825 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.296074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14558547-b707-4559-b224-9948df5dea7c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.297741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.298380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.298695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.298971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.299794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.300095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.300769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.301578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.301859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.302129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.302225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.312590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.314507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.325259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 245/487] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.325259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.326178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf44a-f07d-4949-9422-90fb45f4953b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.331431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.332302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.332577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.332900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.334019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:17.340348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.341247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.344334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.346299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.351741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2031d-1d5b-482e-898b-1bcfd957b3f7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.356341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.357167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.357447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.357718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.364812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:17.365172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.366023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.366836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.367400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.382544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80df29-dece-4388-9f98-246206844276 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.383872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:41:17.385533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 244/490] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.386713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.387358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.388053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.388329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.388599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.389441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.389742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.392012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.397497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2537a4-8139-4011-ba64-2c5becd884de admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.401972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.402618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.402899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.403174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.403904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.404206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.404869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.405831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.413135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.419687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b0ec-af32-4a14-a636-ed70e98ea85a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.425218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.425983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.426258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.426629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.427004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.427484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.427791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.427964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.434904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.438276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ed80-7742-419d-a597-c1b2cb5e4949 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.442780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.443566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.443848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.444123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.451230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.453803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.455154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.455969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.466027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99a80-ef53-4488-a355-66b98af70685 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.469185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:17.470773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.471589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.471918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.472195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.476005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.476901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.482902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.485139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.487201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6280c6-39d6-4555-9d8d-5fc342e6a926 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.491665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.492438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.492722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.493019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.499018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:17.501087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.501867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.504472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.506333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.519169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128837dd-35cd-4f8f-8f51-e2c92da707f1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.523844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.524610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.524894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.525222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.525832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:17.526118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.526472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.527041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.527937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.528401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.537595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1faa2-962f-4d14-9347-5fae23e01ac4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.541404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.542076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.547647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.548290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.549220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.549707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.550725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.551235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.553347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.557535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38c22-dfe4-478a-a552-be96485cad0c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.563280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.563923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.564204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.564519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.565504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.565685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.567375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.569395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.570492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.580786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922195-c378-47f2-ab2c-3e61d4b1efa8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.585494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.586381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.586633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.587213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.587367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.587917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.588980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e3be860ad77f429ab00e7ce038b7c735) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.589513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.591670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.597443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6355-ed2e-482d-8112-811790e2d55f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.597988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/role_assignments?user.id=e3be860ad77f429ab00e7ce038b7c735&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.599313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.602391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.603448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.603819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.604232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/aa9eafe94021438cbcdae8466277f9d5/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.610459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9258-4163-4c7f-b826-3a0de4048d13 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.615284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.616350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.616781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.617225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.622342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=aa9eafe94021438cbcdae8466277f9d5, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.626058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.626329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.628701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.644555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 252/501] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:17 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/aa9eafe94021438cbcdae8466277f9d5/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:17.645121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:17.646602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 250/502] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:17.656522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.675791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d71e3-634a-4776-8518-44ff02c6be0d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.788913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.789561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.789788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.790059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.790873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:17.791178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.793132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf68b-1acd-4d80-aa1a-434518b93d09 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.807549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 251/503] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:17.814868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.839823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61918-d6b9-4a31-8365-686b296e673b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.854974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.855902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.856180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.856454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/1052f3aba4c24b1aab7ec4ddf46cf820/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.877815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=1052f3aba4c24b1aab7ec4ddf46cf820, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.880781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5169d-7b30-4f03-af96-d0c0a73e7e3d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.900284 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 253/504] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:17 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/1052f3aba4c24b1aab7ec4ddf46cf820/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:19.443969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaceb6-aeff-4b53-a57f-783d4e6dbde2 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.444474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaceb6-aeff-4b53-a57f-783d4e6dbde2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.444579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaceb6-aeff-4b53-a57f-783d4e6dbde2 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.446537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 252/505] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:19.463767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.464700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.465204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.490201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:19.491448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:19.568346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 254/506] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:19.606522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaceb6-aeff-4b53-a57f-783d4e6dbde2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.622836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaceb6-aeff-4b53-a57f-783d4e6dbde2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.632649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.633760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.634247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.634719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.648649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:19.655942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6387a04b-1594-4336-adb3-8f023fad70b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:19.657879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 253/507] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:19.664221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.677900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6078-0778-4486-ae78-a5d6aea805e1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.685015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.685674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.685951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.686223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.686987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:19.687320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.688966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.702511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901384-8329-48cc-a88d-d05da49e6c28 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.703294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901384-8329-48cc-a88d-d05da49e6c28 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.705411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 255/508] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:19.705957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1901384-8329-48cc-a88d-d05da49e6c28 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.707994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 254/509] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:19.711166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.720813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.721398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.721873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.722524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb645f-6ba7-44ca-b942-032c7bc69f19 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.727390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.728988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.728988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.728988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.743907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.745877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.761928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:19.763325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:19.763473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:19.765083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 256/510] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:19.771315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.777943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 255/511] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:19.783415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21b889-376d-42a4-a455-59fa9f558cef admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.792363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.793103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.793443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.793715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.794502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:19.794810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.796394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.803614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.814469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a51f-54a2-462d-bc54-99d86c11c600 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.819937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:19.822332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.823125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.823408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.823685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.825919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.840421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7cf45-70c1-42a4-8e0f-73925915c942 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.846550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:19.853616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:19.854821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:19.862776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.864065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.864346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.864619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.867463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.878410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.880439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.887211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6de48-ca14-46e2-bbc5-7fae9766211d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.899808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:41:19.901177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:19.904124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.904784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.905101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.905380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.906666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:19.906975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.908670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.910910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.924446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:19.927854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786c62-f05a-47a0-86fa-c77750e4bdbc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.932471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.933162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.933445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.933720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.934572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:19.934881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.936743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.939044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.949900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa929-f295-4e82-8e9b-9645ebd0fd03 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.960218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.961027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.961310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.961581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.977929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 259/516] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:19.979087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.980979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.985231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.995508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944faf5c-9550-4ba9-889b-cb69f9b5d513 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.007756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.008714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.009235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.009709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.011175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.017142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:20.020906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.023315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.024796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.040574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d93a-72a5-4aa5-888d-8cd3d687323d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.046581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 260/518] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:41:20.054574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.056531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.057604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.059176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.059650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.061805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.062441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.065810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.075190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81ec07-8276-409f-8192-2643f8119e6a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.084227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.085412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.087352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.087843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.091157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.095700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.115393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c751f7-3e73-4b9c-bbde-4a00fb9dec53 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.116613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.118767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.130350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.131583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.132086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.132555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.151294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.153860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.156170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.158270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 261/520] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.165683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.176859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c2d3-8b6d-4918-9292-f39e91c23e6d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.180958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:20.188973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.188973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.188973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.188973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.189385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.189385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.189385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.190270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:20.198201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.205978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 262/522] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.212235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.222793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e35b-a86e-4125-a32d-ec43b661aaf5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.223710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452c087-a2cd-41a4-90c6-2eed9cdff654 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.229524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.230633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.230916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.231193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.232887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.234797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.235079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.235351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.236429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.238195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.240973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.251756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.254098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.286166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 261/523] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:20.287107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.289267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:20.290499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:20.296585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.311320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85030f5-49c9-4bbd-b4a2-8260732eb402 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.314762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da15a6-6f92-43cd-a719-1e8a6ccb1287 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.322409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.323000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.324173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.324451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.324914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.325263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.325478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.326116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.326934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.327240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.332530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c34230-2c98-4c22-8805-c64fe971fa9f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.342003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.346869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.351612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 264/525] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:20.357549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658032-7506-4c59-b264-50b9b9187fdf None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.359203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658032-7506-4c59-b264-50b9b9187fdf None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.359485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658032-7506-4c59-b264-50b9b9187fdf None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.361585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 265/526] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:20.362325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658032-7506-4c59-b264-50b9b9187fdf None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.364967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 262/527] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:20.370852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.381140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576986-767c-4b8c-9eeb-968d631b6af4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.383666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658032-7506-4c59-b264-50b9b9187fdf None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.386517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.387572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.388080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.388366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.388708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.389019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.389306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.389584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.390147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e5854e1cb2f34a049f72909a002dde73) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.390551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.392890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d262ec-3980-4eaa-91b8-2fc6c643b47e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.398901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 266/528] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/role_assignments?user.id=e5854e1cb2f34a049f72909a002dde73&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.400201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.400384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.400694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.402653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.404720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.419270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:20.420512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:20.423790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.425430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 263/529] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.432802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.439096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 267/530] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:20.464349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.472252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dbae7-ba3a-4744-9949-c18afab81920 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.476185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02336d-9b3e-4339-b584-a945236ccaa1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.481439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.482811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.483417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.483981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.488075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.489247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.489537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.489817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.490617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.490928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.492914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.512601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:20.525260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 264/531] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.526690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:20.528117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 268/532] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:20.534179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.543079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.552578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bbad-40bc-480d-92c4-b8bb628eca0f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.559918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e199-75d2-48da-a0b8-18fcc34a4301 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.560666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.561951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.562579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.563053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.569683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.570365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.570651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.570929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.572077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.572392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.573154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.574087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.575814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.594845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 269/533] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.607182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:20.609220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 265/534] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.612553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.621110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.627372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d2f6-ecb7-4f76-bcb4-700cbef250b5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.638024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.639647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.640334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.642165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.645010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd4b3-4650-4495-a810-081477e213d9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.652784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.654148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.654499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.654783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.655706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.656121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.658781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.659021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175d3a-21ee-446f-aaa4-844759ffb0c9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.661083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.671965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 266/535] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.674232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845c9c-e31a-4606-8f3a-0ea814f1f66e None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.674232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845c9c-e31a-4606-8f3a-0ea814f1f66e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.674232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3845c9c-e31a-4606-8f3a-0ea814f1f66e None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.675526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 267/536] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:20.679988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.680903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 270/537] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.681236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162cac-c20c-4a67-baca-9814555104dd None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.681527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162cac-c20c-4a67-baca-9814555104dd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.681695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.681785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05162cac-c20c-4a67-baca-9814555104dd None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.683636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 268/538] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:20 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:20.684919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391154-31a1-4bfd-aae9-747bd6b67700 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.685231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391154-31a1-4bfd-aae9-747bd6b67700 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.685508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391154-31a1-4bfd-aae9-747bd6b67700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.693732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c743-0571-4cdd-84ea-dd21342bb015 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.698232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.698876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.699161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.699426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.700274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.700580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.702464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.705940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-22391154-31a1-4bfd-aae9-747bd6b67700 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:20.707140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-22391154-31a1-4bfd-aae9-747bd6b67700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:20.709626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 271/539] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.710614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.719436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 269/540] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:20.720596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.720882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.721183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.737077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba045e-cf02-4a48-b982-6c7620d55158 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.743300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:20.744533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:20.748831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.750466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.750821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.751165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.751992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.752363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.754524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.758010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 270/541] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:20.759333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.767771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.774282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.775883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861f1e-79c7-449d-8fe6-96028aaae96d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.781136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.782167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.782395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.782724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.786386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dbf8a-28b8-49e6-b23c-0fc165dd11e2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.791711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.792913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.793424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.793895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.794655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:20.802447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:20.804138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.804593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.805681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.808011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.816228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee942be-1635-4945-912c-f070935f39ed admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.821357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.822162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.822500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.822779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.825564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:20.827162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 273/544] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:20.828703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.837005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:20.839182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def559-ad68-4ea8-b637-d0854c76d950 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.844543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.845246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.845525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.845796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.845976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:20.846570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.846872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.847680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 272/545] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.848507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.848674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.857845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 274/546] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.858787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.859121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028f6e8-4cc5-4eb3-b28f-ee607f785ac7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.864208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.865324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.865809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.866281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.867395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.867920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.869235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251bcc-ea33-4694-9e7c-684a38414c6c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.870482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.875090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.875765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.876048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.876322 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.877130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.877437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.879301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.889692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 275/547] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.891115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.896580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 273/548] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.897877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.901810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef777111-2e24-4dba-a9cf-3155cb4560fb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.907027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.907828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.908105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.908370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.911670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3bff-28c1-4444-89e2-ddc4fb2f3ea5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.916769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.918007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.918567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.919055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.919518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.921446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.933999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.936282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.940221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.941802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 276/549] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.942602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.952207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e3ec7-5d08-42a2-929c-9dd17a76d903 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.957420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.958036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.958826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.959103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.959373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.959943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 274/550] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.960934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:20.972125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.972893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902f96-0cfa-4565-bf36-ba28048504ac admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:20.974011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.977956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:20.978608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:20.978890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:20.979162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:20.979886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:20.980190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:20.981803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:20.992962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:20.994422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 277/551] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:20.994827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 275/552] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:20.994985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.000776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.009901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155798-091e-4ffc-b9c4-fedc8966d111 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.012599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f2bd-c8e6-4330-a4d1-d736e2872f9c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.014403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.015066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.015347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.016157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.016888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.017259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.018508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.018840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.019217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.019441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.019713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.020443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.020745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.022426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.032751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 278/553] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.034383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.042280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 276/554] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:21.043266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.044502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380fdb-5e8f-422f-935e-af836352c922 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.049377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.050237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.050515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.050846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.055209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7e03-c722-4a87-99d3-b8d37d504b1a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.059836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.060662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.061678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.061911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.062019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.062235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.071163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.073206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.076047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:41:21.077348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 279/555] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/users/neutron => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:21.078684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.088344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881065e-cd6d-4361-ba91-f3de3d8a1f18 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.089899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:41:21.091228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 277/556] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:21.091869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.093372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.094714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.094992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.095265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.103651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.104243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc92d4-fd7b-480e-9efa-4c1c9b172bb3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.105653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.111095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.112114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.112462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.112802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.113840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.114212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.116124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.125818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:21.127724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:21.129065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.135683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1160 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.136460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.139817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76342f-5eee-4b2d-8ead-4cf9ce89a1e5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.146239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.147263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.147798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16664-0bd9-4a9a-a486-4f73b710fb5b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.148067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.148544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.149688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.150212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.152288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.152662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.152930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.153247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.153523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.154311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.154618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.156476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.168273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.169143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.173850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 281/560] 10.222.0.42 () {56 vars in 1158 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.184981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0fba-bcbc-431a-a07d-f30228e6bda6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.185133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.185210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.185210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.185210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.185210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.190128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e6df-1aa7-460e-856f-1a43b8ed5870 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.193759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.194661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.195299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.195580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.195685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.195842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.205239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.206115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 280/561] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:21.206895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.207001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.221047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ac59-7882-405f-989a-111de02f03d4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.223988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 282/562] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:21.225454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.226307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.226598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.226861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e3be860ad77f429ab00e7ce038b7c735/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.230967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.242048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249b13-f764-448d-9413-f448a3e3cc92 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.243257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=e3be860ad77f429ab00e7ce038b7c735, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.246684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.246865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.247595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.247879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.248153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.262847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 281/563] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:21 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e3be860ad77f429ab00e7ce038b7c735/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:21.263745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.274358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.276287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.303634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:21.313530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 283/564] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:21.314286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.334788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a68509-c9a7-4228-b686-a626fb0b4900 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.335628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd548a-e2da-4631-942b-acfd4155ae38 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.339464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.340498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.340967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.341345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.345352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.346024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.346307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.346583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.347326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.347688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.349332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.353559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.355551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.372214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:21.376333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:21.377853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 282/566] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:21.378768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.385582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.400982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c500e0-8e23-4c27-93f4-88d2a93eb9d4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.405850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5624-d059-40fb-8f51-350ee907082e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.411876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.412691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.412998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.413278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.415530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.416202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.416480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.416754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.417530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.417838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.419470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.432964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.434967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.440732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 283/567] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:21.452273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.465472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:21.467102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 285/568] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:21.473994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.476000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8375c-6223-484e-adb4-7b848ceb54c6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.480699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.481547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.481832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.482108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.493497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f4057-626a-4b93-89b3-8aedf39637fd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.494746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.496776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.508555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.509456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.509936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.510424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.511860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.512396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.514627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.529381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:21.530636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 284/569] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:21.540433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.549404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 286/570] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.557240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.567282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b512-cc6d-42a1-b12e-3464056ae13e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.568372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8268-eb5f-4422-83f2-e1f7077e66dc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.576121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.576121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.576615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.576615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.577828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=aa9eafe94021438cbcdae8466277f9d5) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.579448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.580176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.580979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.581256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.581531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.582355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.582663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.584677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb66e7-d139-4a9f-80d8-dca2a229c9d8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.587154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.600937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 287/571] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/role_assignments?user.id=aa9eafe94021438cbcdae8466277f9d5&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:21.607882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 285/572] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:21.614316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:21.626329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec82a9-ce5c-467c-b3c1-2dac1f574437 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:21.631970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:21.632644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:21.632929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:21.633242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:21.634132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=1052f3aba4c24b1aab7ec4ddf46cf820) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:21.634446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:21.636364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f1958-a12e-49d7-8407-e239e2c03c82 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:21.643836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 288/573] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:21 2021] GET /identity/v3/role_assignments?user.id=1052f3aba4c24b1aab7ec4ddf46cf820&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:23.249903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500594e4-10a1-498a-85a0-15758dab2f67 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.250913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500594e4-10a1-498a-85a0-15758dab2f67 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.251396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500594e4-10a1-498a-85a0-15758dab2f67 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.254097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 286/574] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:23.261488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.262026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.262026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.289630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:23.290903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.304866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 289/575] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:23.331691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500594e4-10a1-498a-85a0-15758dab2f67 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.344847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500594e4-10a1-498a-85a0-15758dab2f67 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.349433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.350321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.350764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.351099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.363249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.365258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.382520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:23.389066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 287/576] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:23.391253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.400460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddf7d-6efd-4bd3-85dc-d007686f434c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.405350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.406172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.406553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.406926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.407763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:23.408167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.409905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff0e76-446f-470c-9127-55ede89056a4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.426327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 290/577] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:23.438913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.449094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fab14-6266-4ab1-908f-b8407aff0683 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.451960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6d104-afb6-43fd-8cea-a0dec560a573 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.452366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6d104-afb6-43fd-8cea-a0dec560a573 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.452748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6d104-afb6-43fd-8cea-a0dec560a573 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.456448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 291/578] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:23.459602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.460538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.461959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.462344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.462725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.464383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.465142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.466496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.469600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.492642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:23.494060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.505819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 288/579] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:23 2021] POST /identity/v3/users => generated 254 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:23.510404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 292/580] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:23.557091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.567873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c032c-d624-4c80-a5db-1c8c4d9fad2b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.572823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.573876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.574261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.574636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.587891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:23.595361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:23.597033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:23.606419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.618642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986fac-f563-4bbe-8cab-d63276a4bdf3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.626536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.627228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.627513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.627785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.628831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:23.629173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.630915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.646260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:23.651928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.666261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10590f-da63-40c9-a6cf-72ed48a677d3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.674796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.675611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.675893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.676170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.690057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.691918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.711282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:23.712975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:23.722313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.733480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83635f8-035e-415f-ac5e-7fff42c2ec49 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.741296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.742105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.742394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.742674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.743491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:23.743802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.745527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.767869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:23.776265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.787615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a3bd-1800-4a95-9c02-46d133da99c6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.793669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.794450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.794824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.795097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.803992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.806153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.822047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:23.823658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:23.830323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.840564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e65f2d-5dec-4f9f-8852-e52b36cc8d7b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.845845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.846575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.846857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.847133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.848043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:23.848436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.850447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.869283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 295/586] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:23.876079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.889184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd493-92fe-4e80-a8d8-fff0da568561 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.895464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.896207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.896490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.896760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.905562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.908001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.917789 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 292/587] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:41:23.923779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.936326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e42bf-bc67-4045-9a1a-f3be0f108cb4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.941902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.942703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.942984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.943251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.959795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.962210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.982669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:23.984645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:23.990360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.002756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bb95-fbd7-4ce9-8792-521f9a5e5caf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.007730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.008389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.008662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.008938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.009710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.010014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.011609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.026740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.032852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.042938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f06e1-5a97-432d-ab51-2ed086f3e02b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.047566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.048352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.048654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.048903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.056396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.058408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.071982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:24.073520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 297/590] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:24.082162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.092362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99156c08-a61e-4c04-ae9e-a4db9a1e9411 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.097931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.098587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.098912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.099188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.099982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.100342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.102297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63d52-729c-474d-90e7-4992f67d9bd9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.116983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 294/591] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.123289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.135925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd6c3-07c8-4019-8d41-340dbdae4dab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.148692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.149817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.150267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.150723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.152220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.152748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.156633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97c742-1f4d-430d-aad6-785d6e5d9396 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.173430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.550578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814855-5b1d-4a81-b160-c08cc9a4cc14 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.551097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814855-5b1d-4a81-b160-c08cc9a4cc14 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.551097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814855-5b1d-4a81-b160-c08cc9a4cc14 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.552863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 295/593] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:24.560765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.561217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.561313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.581780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:24.584377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:24.598290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 299/594] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:24.630003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814855-5b1d-4a81-b160-c08cc9a4cc14 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.643420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814855-5b1d-4a81-b160-c08cc9a4cc14 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.648537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.650875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.651156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.651907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] PATH_INFO: `/v3/services/network` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.652755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.653808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:24.653808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:24.653808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:24.654747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.672255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3dd999af-d0a7-4570-bffc-f728078fc2fd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:41:24.673819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:24.680527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.690890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e8be-6896-4f89-943e-d6f24a523599 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.691565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fdadf-73d1-4f1c-bffa-1f50632c6038 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.691784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fdadf-73d1-4f1c-bffa-1f50632c6038 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.692031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fdadf-73d1-4f1c-bffa-1f50632c6038 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.694458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 297/596] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:24.696637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.697320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.697592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.697853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.698573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.698922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.700265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:24.700265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:24.700265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:24.700713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.700860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.701046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.701193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.707535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 300/597] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.718246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.724717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:24.725981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:24.735829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 298/598] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:24.741922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee702-57df-49e0-a037-217c592ef1b8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.758594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.759259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.759535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.759805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.760585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] RBAC: Adding query filter params (type=network) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.760883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.762565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01d01-79c1-483e-8f2d-05364b8f583a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.767988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.787765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bd74-7e20-4214-9791-46d50c95b729 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.788074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 301/599] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services?type=network => generated 124 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.796728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbcec-8620-4c87-ba54-a0d058f64370 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.796728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbcec-8620-4c87-ba54-a0d058f64370 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.796728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbcec-8620-4c87-ba54-a0d058f64370 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.796728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 302/600] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:24.806010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.806360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.806360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.806650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.806793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.806932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.810154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.825427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:24.828350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:24.842591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 303/601] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:24.844833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:24.860620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:24.862377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 299/602] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:24.863661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.868890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.874173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1d205-806c-40b1-899f-21554a2b7082 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.880905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.882112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.882599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.883078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425234d-ed80-45db-8e8a-1649a3341ba2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.883188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.884191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.885466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:24.885466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:24.885466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:24.886737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.899733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.900407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.900686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.900975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.901752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.902064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.903594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:41:24.903704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.910567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 304/603] 10.222.0.42 () {56 vars in 1150 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:24.913673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.924909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 300/604] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:24.926121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6da62-2fdb-4f57-aa71-a398358f540b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.930963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.932209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.933202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.933833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.934404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.935338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.935897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.938787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.947836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 305/605] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:24.955534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edbbc-ab45-4c74-98e6-1008249c1dc2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.960721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.970394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.971785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.973336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.974050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.977407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302bfdf-7106-43bf-a924-fbeffaca3b11 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.990647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.992524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.993070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.993889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.996402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:24.997849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.001696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.002989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.004679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.014725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 306/606] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:25.031310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:25.033505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 301/607] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:25.042359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.059476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24087b9-25e0-4d74-9880-8f9502d7ca70 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.073902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.074591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.074874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.075148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.075960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:25.076208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.078441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.094909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 307/608] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:25.101075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.112177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e92f8-7a2c-46fd-a66a-8dc1b26f5000 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.117386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.118581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.119099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.119583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.129864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.132376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.149315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:25.151127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 302/609] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:25.158258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.170097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bf180-ff84-482e-8997-1b78f940dce5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.174811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.175536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.175814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.176084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.177079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:25.177386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.179357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.203561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 308/610] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:25.210041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.220761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2875af-cf65-424c-a2f2-6f08a07edb81 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.225686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.226338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.226617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.226940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.236564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.238503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.257847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.269760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 303/611] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:25.273832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8019cbe-d4a9-48a5-98c6-34439e806f55 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.278613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.279461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.279733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.280052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.295355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.299451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.323929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:25.325721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 309/612] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:25.332025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.341034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5bc61-81c6-41f5-8c71-9a14f243a7c4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.345698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.346401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.346682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.346953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.347681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:25.347982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.349585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.362147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 304/613] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:25.368369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.380019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2364c-d6eb-4412-a437-7dcac8ef0b5e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.384706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.385572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.385846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.386163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.394326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.396426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.410915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:25.412459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 310/614] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:25.419005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.430141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd02de-124c-4ca5-a516-130c62f64d3e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.434910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.435562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.435885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.436157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.437044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:25.437956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.439841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526ec1-26a9-4ad6-b7e8-ddb65dacaa00 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.457549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 305/615] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:25.464334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:25.478042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d7d25-eb99-44ba-b91b-8452d9db5402 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:25.485640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:25.486294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:25.486569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:25.486892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:25.487735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e3be860ad77f429ab00e7ce038b7c735) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:25.488092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:25.490143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1007a-1ff1-47fa-aa31-b6e9b48b9358 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:25.496833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 311/616] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:25 2021] GET /identity/v3/role_assignments?user.id=e3be860ad77f429ab00e7ce038b7c735&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:26.591218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb713-9407-4c05-b37d-d144706b87d9 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.591762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb713-9407-4c05-b37d-d144706b87d9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.591762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb713-9407-4c05-b37d-d144706b87d9 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.593809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 306/617] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:26.600988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.600988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.600988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.627657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:26.629425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:26.640302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 312/618] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:26.664903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb713-9407-4c05-b37d-d144706b87d9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.681571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb713-9407-4c05-b37d-d144706b87d9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.691810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.692846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.693385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.693862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.709783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:26.716969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:26.723302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 307/619] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:26.725750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.738699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87f621-3304-46c5-92df-46b6d91b0666 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.754412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.755363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.755858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.756336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.757334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:26.757827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.759629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:26.768979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 313/620] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:26.775348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.789949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee74e-be16-438a-8f6f-662657834625 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.796255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.797106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.797389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.797663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.816594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.818472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:26.842232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:26.844391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 308/621] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:26.850818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.860922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96252a3-5e40-4f48-86ba-dccd933d19fe admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.865604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.866484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.866956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.867423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.868370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:26.868864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.870662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:26.888031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 314/622] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:26.895128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.905258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f775-327d-406e-b6ba-a64f1b9a03b1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.910619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.911718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.912197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.912654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.922214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.924745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:26.940302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:26.947371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 309/623] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:26.949155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:26.965964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807eabc-898a-42bf-9863-ce67672f73c7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:26.971285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:26.972161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:26.972636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:26.973153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:26.974207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:26.974705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:26.976755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.005090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 315/624] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:26 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:27.011790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.028991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc9df-32eb-4733-bdbd-76d82c65be79 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.039798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.040456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.040738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.041036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.056595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.058393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cda05e-9aae-462f-95ca-12e316b224af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.072116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 310/625] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:27.078659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.087805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825797-c77f-4538-a9a2-bedceb1d5556 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.088089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825797-c77f-4538-a9a2-bedceb1d5556 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.088368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825797-c77f-4538-a9a2-bedceb1d5556 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.091663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 311/626] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:27.095070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e0dc-588a-428b-86ac-7288ba8f6be2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.101226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.101513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.101790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.113379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.113994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.114277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.114556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.135192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.137084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.138758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:27.139973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:27.160849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:27.164684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 312/627] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:27.166231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 316/628] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:27.172689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.185946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9698dfd-cfba-4c03-afb4-b062294af3bb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.187951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.198877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aff4b-8053-4506-8249-996d6a15f9e7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.203583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.203717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.204289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.204395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.204567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.204726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.204871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.205076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.205895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.206202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.207871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.215935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:27.223449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:27.224979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 317/629] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:27.226641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 313/630] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:27.231266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.232831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.249842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdffe2-1a2a-4ff1-bad2-cfcd3e07d9bf admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.252502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7ba8-87a2-4c10-bd88-f33bd1078cab admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.260136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.260815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.261128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.264006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.264006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.264006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.264006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.266245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.267042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.267317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.267586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.276798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.278821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.279811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:27.288459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.303703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669962a-d2c5-4b3a-89ea-57cdb9f4cbf6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.313139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.314283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.314818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.315291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.319570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:27.320816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 318/632] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:27.327097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.329685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.331999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.349870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:27.351318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e48c5-ad85-4773-94bb-1eaaa7981bfc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.351915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 315/633] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:27.358108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.366660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.367205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.367489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.367762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.368560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.368865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.370506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b340b-0e9c-495e-ab2c-3d82f97014d8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.370739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.376201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.377140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.377729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.378506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.379489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.380007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.381997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.395868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 316/634] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:27.402106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.403367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 319/635] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:27.409715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.413692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd156c4e-4403-4f0d-b9b3-10dd42f7cc10 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.418790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.419953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.420445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.421032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.430189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.431504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1c21-73e4-4bfe-be3d-7089dbda062b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.432907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.450069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:27.450606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.451273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.451552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.451820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.456991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=a14e56830d1145278d5012377b283e4d) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.456991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.456991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.457719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 317/636] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:27.460626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.472459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 320/637] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/role_assignments?user.id=a14e56830d1145278d5012377b283e4d&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:27.474364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720c84-6b79-4d3c-8377-26e5d46fb4fb admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.479643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.480831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.481364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.481899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.482993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.483553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.486411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.507861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 318/638] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:27.514734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.526216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50ec91-6457-411e-9385-bda4457f3af1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.531952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.533195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.533682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.534188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.547721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.550190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.570860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-1b87fb58-961a-442f-89df-07da1d73fba4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:27.572795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 321/639] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:27.579510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.591255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88299fc-bb15-4a79-abef-2d4fb3e11e3f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.594639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d659f-83f5-4fb2-9549-a9abd1631a7f None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.595393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d659f-83f5-4fb2-9549-a9abd1631a7f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.595963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d659f-83f5-4fb2-9549-a9abd1631a7f None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.599059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 322/640] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:27.605136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.605683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.605966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.606286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.607034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.607336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.608298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.609952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.610401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.611420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.624526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 319/641] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:27.631688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.642445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:27.642981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4ad1-bfe9-4b26-8666-ef8ecb99b6d7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.644522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:27.648460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.649466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.649816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.650183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.655162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 323/642] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:27.662258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.664620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.681053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.681243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:27.682933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 320/643] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:27.694980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.696195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4ba3-5bd1-4b25-9854-3cd37b63c1b7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.701207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.701893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.702239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.702577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.703823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.704583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:27.704583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:27.704583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:27.705709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.713189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da97bb6-b365-4afa-b9e7-081249dc207b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.720932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.721754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.722082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.722404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.723296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:27.726216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.731812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 324/644] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:27 2021] POST /identity/v3/services => generated 240 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:27.737568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb9597-015b-40fc-a9f9-7f1a273881b6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.756202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 321/645] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:27.762663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.797411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7a27-1773-410a-bb60-6e3e66bc2704 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.805297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.806215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.806492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.806821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.814837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=d0942cb70c474b06a9ea51db2f3298c0, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.818161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af8816-0c33-4d79-8c04-a532b35b43f3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.841568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 325/646] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:27 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:27.947305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6923-e482-4f4b-8d78-2c109acf56b0 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.947662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6923-e482-4f4b-8d78-2c109acf56b0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.947852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6923-e482-4f4b-8d78-2c109acf56b0 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.949965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 322/647] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:27.956728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106d7c-f56e-409e-94ac-d74da54f99c3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.957382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106d7c-f56e-409e-94ac-d74da54f99c3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.957853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106d7c-f56e-409e-94ac-d74da54f99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.981651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-33106d7c-f56e-409e-94ac-d74da54f99c3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:27.983267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-33106d7c-f56e-409e-94ac-d74da54f99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:28.062531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 326/648] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:27 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:28.100805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6923-e482-4f4b-8d78-2c109acf56b0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:28.116973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6923-e482-4f4b-8d78-2c109acf56b0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:28.122462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:28.123265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:28.123645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:28.123926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:28.125358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:28.126384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:28.126384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:28.126384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:28.127260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c830-19af-4caf-ac51-0be4bb8d8b71 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:28.150190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 323/649] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:28 2021] POST /identity/v3/services => generated 251 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:28.847448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50e4a-4071-426a-8a32-b67420f37824 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:28.847963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50e4a-4071-426a-8a32-b67420f37824 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:28.847963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50e4a-4071-426a-8a32-b67420f37824 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:28.850200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 327/650] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:28.856480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:28.856935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:28.857061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:28.885968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:28.887154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:28.916189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 324/651] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:28 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:28.943140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50e4a-4071-426a-8a32-b67420f37824 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:28.955448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50e4a-4071-426a-8a32-b67420f37824 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:28.959818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:28.960595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:28.960864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:28.961159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:28.972184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:28.979153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:28.980653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 328/652] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:28.987748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:28.999317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1e7b8-9a6a-4de6-88c1-af53d75e4cfc None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.009569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.010233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.010510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.010779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.011542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.011843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.013470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.023112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 325/653] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:29.029703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.046530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f41d60-47c1-4119-ab63-2a203ade7be1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.057156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.057947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.058220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.058489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.076645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.079078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.096040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:29.097602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 329/654] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:29.103804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.127353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b4a50-d332-4e55-b6fe-fcd35a672726 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.134994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.135655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.135935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.136209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.136962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.137273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.138876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.159232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 326/655] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:29.165630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.181989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130cf7-2875-4506-8b86-65dedeef49d0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.193075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.194141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.194594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.195031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.210962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.213298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.236877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:29.238484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 330/656] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:29.244891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.262408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7441-3800-4454-9b3e-58832ee38676 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.274137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.274809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.275088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.275356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.276202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.276507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.278396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.308700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 327/657] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:29.315730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.332361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f649db-9862-49ac-8147-f4e456036822 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.340984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.341838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.342288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.342835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.361837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.363983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.379060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 331/658] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:29.384884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.401826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588fb6-678a-40b2-a0b2-6759bb693eca admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.415124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.415931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.416209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.416482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.436726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.439148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.467208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:29.473282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 328/659] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:29.475497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.485130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce9a4-35d9-4e4b-964e-bd5cc05e0e4f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.489746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.490396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.490676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.490947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.491676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.491978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.493616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.509801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 332/660] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:29.515952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.528424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46d2-de21-4241-a1e7-ffeceefb962b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.533698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.534483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.534762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.535035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.545856 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.548478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.568657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:29.570202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 329/661] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:29.576173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.590347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185894f-2d22-4230-9221-0a056f12edf2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.599956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.600613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.600894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.601189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.601996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.602302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.604138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865e97-7431-4f12-831a-38870799c49f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.622209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 333/662] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:29.628872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:29.641976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7de0-7e51-4f6c-96a7-77bceb5784cf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:29.653607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:29.654270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:29.654555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:29.654832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:29.655682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e3be860ad77f429ab00e7ce038b7c735) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:29.656527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:29.658394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3d72f-eed3-4272-9bda-e781d6b78b65 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:29.664488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 330/663] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:29 2021] GET /identity/v3/role_assignments?user.id=e3be860ad77f429ab00e7ce038b7c735&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:30.433846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47d1a-4e28-4198-9159-364ca0857d7b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.434488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47d1a-4e28-4198-9159-364ca0857d7b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.434488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b47d1a-4e28-4198-9159-364ca0857d7b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.436436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 334/664] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:30.442763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f86d-b9ee-4ba2-b207-9d3dcfd6aa63 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.443308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f86d-b9ee-4ba2-b207-9d3dcfd6aa63 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.443308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f86d-b9ee-4ba2-b207-9d3dcfd6aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.462669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8672f86d-b9ee-4ba2-b207-9d3dcfd6aa63 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:30.463864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8672f86d-b9ee-4ba2-b207-9d3dcfd6aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:30.472059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 331/665] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:30 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:30.473639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439901-8399-4c77-b06e-6019d4331893 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.473929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439901-8399-4c77-b06e-6019d4331893 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.474203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439901-8399-4c77-b06e-6019d4331893 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.476341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 335/666] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:30.482151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.482439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.482718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.504135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:30.505371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:30.516493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 332/667] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:30 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:30.524688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26439901-8399-4c77-b06e-6019d4331893 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.537083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26439901-8399-4c77-b06e-6019d4331893 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.549762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.550267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.550573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.550862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.551139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.560291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e8189-5a55-48d9-ba92-0f20237ab361 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.565906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.566851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.567133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.567408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.568079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.569878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:30.570065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.576980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:30.581323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:41:30.585280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 336/669] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:30.585474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 333/669] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:30.586158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.589613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.600778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b516-9d03-4d0e-a42e-c97be6f0d9f3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.601847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e80dc-fbf6-4023-a9ad-b4ee8cd305c1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.605718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.606449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.606710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.606984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.607699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.608002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.609643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:30.609643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:30.609643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:30.610689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.611885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.612544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.612826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.613131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.613896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.614207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.615796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.621193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 334/670] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:30.622867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.634226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab494a0-5ff0-4408-94d8-f62c2dd51868 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.636078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 337/671] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:30.639245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.639893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.640261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.640533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.641405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] RBAC: Adding query filter params (type=network) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.641707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.642173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.643448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.656432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 335/672] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:30.657856 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.663445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999893a5-68d4-44bf-8a82-5f91716ef235 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.667659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d616-335c-488f-af5f-21b2282ad31f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.672856 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.673588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.673866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.674139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.675027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] RBAC: Adding query filter params (interface=public, service_id=9213eb5b8bbb480d99c54037e58b7ae9, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.675340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.676333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:30.676333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:30.676333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:30.677244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.678548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.679346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.679631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.679907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.685548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 336/673] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/endpoints?service_id=9213eb5b8bbb480d99c54037e58b7ae9&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:30.692228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.701931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f682-20b8-4de7-a8ae-0e62193fcf0d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.703082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.705032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.706818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.707338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.707859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.708033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.708700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.710364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.721106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 337/674] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/services => generated 772 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:30.723184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:30.724992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 338/675] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:30.731208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.743110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbf7fe-4d61-406d-8b91-815ea4127931 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.757904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.758576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.758912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.759190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.759929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.760284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.762008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.785126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 338/676] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:30.786522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.804691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d881a6-4243-47db-84df-77ab589cae49 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.814525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.815418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.815700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.815976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.834726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.837037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.856740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:30.858425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 339/677] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:30.865189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.879285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ee603-729d-4bdb-a02b-b82ba64dc9b8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.894427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.895108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.895387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.895660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.896517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:30.896824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.898709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d5bbe-4949-4d57-b649-4f7e18084eac admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:30.922802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 339/678] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:30.929764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:30.946630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df31e-13c1-4407-b9c1-e091f31a4f56 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:30.957718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:30.958591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:30.958876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:30.959199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:30.978283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:30.980318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.004994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758eff6-363a-46e6-94e3-2350384a1465 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.005299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:31.005452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758eff6-363a-46e6-94e3-2350384a1465 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.005599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758eff6-363a-46e6-94e3-2350384a1465 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.006578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 340/679] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.011852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 340/680] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:31 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:31.012243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.019621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.020484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.020484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.025964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399eeb5-6553-4fc5-bcb8-ea4eccad5f15 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.034930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.035599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.035879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.036154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.037715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.038025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.040001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.047147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:31.048841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:31.056175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 341/681] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:31.062835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.063904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 341/682] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:31.075319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516a3b-c600-4b7b-b1c3-91802fce8a37 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.080595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.081640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.081922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.082335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.093140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.094702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.098986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.106323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61af76-baa3-406f-a003-2193952619b1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.114216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:31.116019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 342/683] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.125006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.125172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.125172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.125172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.125172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.137854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:31.139409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd30e6-c40b-41aa-86af-fc32b1cd01dc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.146135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:31.148076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 342/684] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.155180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.158662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.160590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.160874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.161354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.163761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.164076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.166518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.178067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fdb43-521d-4123-b7b2-27507e704f5c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.187442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.188153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.188434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.190515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.191353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.191663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.193706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 343/685] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.195104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.200106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.211041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4914a-98af-46e2-812f-da049d680006 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.211218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 343/686] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.216505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.217313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.217421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.217642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.217919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/a14e56830d1145278d5012377b283e4d/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.237735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=a14e56830d1145278d5012377b283e4d, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.238473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3e92-d418-4bb7-88ba-f3146d703bbd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.240636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.247087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.247885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.248160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.248415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.257109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 344/687] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:31 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/a14e56830d1145278d5012377b283e4d/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:41:31.275364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.277262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.312330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:31.313594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 344/688] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:31.320144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.422492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b40e-fd03-4fdd-897a-2129bcea4d57 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.428685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.429408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.429692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.430036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.430805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.431162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.432844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.453611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 345/689] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.460534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.478126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7267d0-1107-4784-8abc-809ef6ed2a0d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.494702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.495510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.495797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.496071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.511304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.513402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.532889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:31.534118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 345/690] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.540610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.558235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1f0f-1341-4c93-9c88-2884586b897c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.563992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.564708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.565016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.565341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.566257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.566616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.568624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3b159-a10c-4aeb-b42b-079048cbf988 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.590375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 346/691] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.597442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.601404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec64f-866d-4143-b666-2fe8a5336956 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.601695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec64f-866d-4143-b666-2fe8a5336956 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.601977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec64f-866d-4143-b666-2fe8a5336956 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.603742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 347/692] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:31.608085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada494cc-3e15-4799-9094-ba2ea7040f12 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.609840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.610128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.610407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.613203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.613895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.614174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.614445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.623239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.625605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.630891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:31.632085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:31.637891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 346/693] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:31.644708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.649049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 348/694] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:31.653967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc139d-57a3-4d16-a0ef-cb8451833ff7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.658881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.659697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.659986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.660259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.666423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.672051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.674076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.675660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b3836-e97e-4510-9576-4887859b9134 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.681260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.682066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.682350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.682621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.683294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.684883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.692704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:31.694365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 347/695] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.697411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:41:31.700289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.701036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 349/696] 10.222.0.42 () {56 vars in 1150 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:31.706290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.721395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631be9d-bc38-4013-80a4-5166248f5c7c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.724081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bb13c-796d-4bfb-9ee6-9edadb4102fb admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.726410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.727200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.727489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.727763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.728532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.728838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.730576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.735920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 350/697] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.737334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.738000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.738275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.738543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.739272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.739574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.741459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.742071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.753426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a6d6-6ad2-48a9-b96f-700fc5edc55e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.759128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.760073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.760583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.761108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.762103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.763141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.765985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.766938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 348/698] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.773768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.777626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 351/699] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:31.783886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.786387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d791a-1b47-432f-97d1-78d41757571c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.795860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42cbe-ffdf-4356-8c40-1f22f7d38f6e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.801271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.802368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.802705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.803138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.803499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.803774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.804040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.804228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.805475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] RBAC: Adding query filter params (interface=public, service_id=e63ced38de784fc4a82b408c7fd41b90, region_id=RegionOne) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.805985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.807250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:31.807250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:31.807250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:31.808543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.816373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.818126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 352/700] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/endpoints?service_id=e63ced38de784fc4a82b408c7fd41b90&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:31.818385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.824706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.847359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:31.849949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce129d-fcf9-48e4-b245-56b0cabfeaa4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.852512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 349/701] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:31.856580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.857633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.858115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.858659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.859591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.862533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.864368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.875353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec242d0-8e86-48ff-8220-5f9d497ece3e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.879197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 353/702] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/services => generated 772 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:31.880836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.881787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.882272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.882792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.883829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.884425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.886679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857624b-165b-486c-867c-6ff93f302607 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.904982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 350/703] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:31.911405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:31.927407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76535-1d11-42d0-af18-ea5b3948da64 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:31.935307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:31.936096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:31.936381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:31.936654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:31.938111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:31.938421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:31.940407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e8ee-5c3f-4cc1-9cd8-46ec3ccbc495 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:31.953832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 354/704] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:31 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.290311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75859-56dd-4c79-bfd0-71765f886f33 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.290931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75859-56dd-4c79-bfd0-71765f886f33 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.291412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75859-56dd-4c79-bfd0-71765f886f33 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.293699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 351/705] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:32.300311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.300585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.300858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.321786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:32.323005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:32.335561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 355/706] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:32 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:32.360912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75859-56dd-4c79-bfd0-71765f886f33 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.376931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75859-56dd-4c79-bfd0-71765f886f33 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.382968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.383759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.384041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.384316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.398453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:32.405465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:32.407234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 352/707] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:32.413855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.423303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480486-6b94-44e9-972e-2bd6334f3777 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.429352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.430030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.430309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.430582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.431357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:32.431664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.433398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.443534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 356/708] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.450286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.462470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903934-d13f-4b7e-ba52-fcf26dc21214 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.467638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.468542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.468827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.469180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.481652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.483604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.503450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:32.505051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 353/709] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:32.511518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.524396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19ed4-bc85-45a5-9644-1c7f55d690b9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.531589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.532497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.533407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.533892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.534847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:32.535355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.537187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.550551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 357/710] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.556754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.568143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815e043-af00-435d-8420-6f9b047682a2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.572894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.573767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.574049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.574382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.591229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.593782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.614818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:32.616614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 354/711] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:32.622694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.633645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448fe79-4e55-43b8-a833-54a96979ba01 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.644603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.645546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.646051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.646525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.647595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:32.648101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.650176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.672754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 358/712] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.678717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.693982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-6ec1-4736-b55f-b400fb15527e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.698792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.699796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.700277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.700746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.716446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.718629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.739470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:32.741254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 355/713] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:32.747260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.758429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e5e9-306e-48fd-b0fa-70c485860b4f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.768768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.769773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.770259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.770749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.771705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:32.772210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.774039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.791080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 359/714] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.797607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.809940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603871f-4b41-4873-9566-cc5501873d47 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.815272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.816302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.816802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.817292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.830589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.832857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.852924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:32.854758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 356/715] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:32.861647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.871843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a732-04e3-4836-a62a-4044a9c2e0b7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.880912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.881860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.882347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.882816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.883851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:32.884361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.886440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56dcba-9e69-45c6-a8bf-48a4b481b508 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.904017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:32.910418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:32.927030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d01-0684-42ac-95e2-00eac8eb7d53 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:32.932193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:32.933445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:32.933932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:32.934430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e3be860ad77f429ab00e7ce038b7c735/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:32.936674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=e3be860ad77f429ab00e7ce038b7c735, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:32.940132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd7b0f-c78d-4224-a4be-ffab93399844 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:32.963749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 357/717] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:32 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/e3be860ad77f429ab00e7ce038b7c735/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:33.794690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95b64-cc24-4679-9ddc-116d52ad5954 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:33.795204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95b64-cc24-4679-9ddc-116d52ad5954 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:33.795309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95b64-cc24-4679-9ddc-116d52ad5954 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:33.797409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 361/718] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:33.803409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:33.803853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:33.803957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:33.823109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:33.824308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:33.885996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 358/719] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:33 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:33.940893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a95b64-cc24-4679-9ddc-116d52ad5954 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:33.955594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a95b64-cc24-4679-9ddc-116d52ad5954 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:33.960907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:33.961718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:33.961997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:33.962268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:33.962940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:33.964562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:33.980277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:41:33.985075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 362/720] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:33 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:33.988315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.002700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f2fb7-099a-497b-b380-4679a0a8d4c8 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.013320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.014001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.014285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.014562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.015901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] RBAC: Adding query filter params (name=network) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.016212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.017909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.023633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 359/721] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:33 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.029918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.043056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdfa03-d926-41bd-aad2-3cff9f2c3957 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.053590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.054189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.054471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.054748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.055479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.055786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.057415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62e0e3-1a3f-46ef-b0bd-7704277d8252 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.069641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 363/722] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/services?type=network => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.075736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.090034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baebcee-aaaf-4fb3-8ec2-7287eb8d619d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.101384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.102097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.102373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.102705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.103474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.104527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:34.104527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:41:34.104527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:41:34.105494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12505fc8-71d2-4783-ab7b-8f321cc16420 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.135541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 360/723] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:34 2021] POST /identity/v3/endpoints => generated 327 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:34.296466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3b0-a19b-4755-bc03-a2629fffaae0 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.296466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3b0-a19b-4755-bc03-a2629fffaae0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.296466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3b0-a19b-4755-bc03-a2629fffaae0 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.298632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 364/724] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:34.304932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.305270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.305424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.334252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:34.335475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:34.360266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 361/725] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:34 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:34.400074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdda3b0-a19b-4755-bc03-a2629fffaae0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.415169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdda3b0-a19b-4755-bc03-a2629fffaae0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.423399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.424261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.424666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.424959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.442183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:34.450692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:41:34.450984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 365/726] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:34.459128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.469493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35038a7-38c5-40c3-b544-067be3cfbcc0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.474949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.475709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.476071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.476353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.477169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.477471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.479233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.493039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 362/727] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.500100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.512058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87c92a-9fd0-4b9b-a54b-c1ea6ad23e7e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.519477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.520343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.520628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.520902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.534369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.536375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.557994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:34.559452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 366/728] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:34.565845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.576864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c43a-3c75-451b-9a4c-f97815fcbd3f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.582807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.583480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.583757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.584026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.584835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.585179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.586902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e814ec-6141-402f-89bd-12ca2c44d58d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.604403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 363/729] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.610936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.621809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152334c1-b1a4-49be-bcf9-5a17dc5e88ed admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.631582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.631582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.631582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.631582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.638326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.640695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.658598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:34.660533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 367/730] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:34.663002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392137c-89ba-45f9-95ee-ca6fcb3582e5 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.663002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392137c-89ba-45f9-95ee-ca6fcb3582e5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.663002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392137c-89ba-45f9-95ee-ca6fcb3582e5 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.667925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 364/731] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:34.669156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.670804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.671087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.672005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.681966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9ae51-7369-48cd-88f7-92829ab1800d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.687041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.687956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.688450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.689011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.690155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.690263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:34.690758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.691374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:34.693343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.703892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 365/732] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:34 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:34.722811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 368/733] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.728842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.734712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.743396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7f81-92d4-4f0e-b716-bdae7bd04f2d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.745474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ba4a-92d2-4b41-aa6d-857a09999fa0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.750700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.751713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.752006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.752122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.752330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.752757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.752955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.753315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.753623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.754911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.763068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.764802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.766644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:41:34.768127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 369/734] 10.222.0.42 () {56 vars in 1150 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:34.774374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 366/735] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/auth/tokens => generated 1419 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:34.774718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.780288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.787333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ce5a6-a93f-45bf-b03b-ca5cd1eed57d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.789679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc766-ad91-4be2-8988-79b1748ee122 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.792342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.793241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.793617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.793983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.794895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.795453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.795888 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.797430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.797891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.798073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.798449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.803518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 370/736] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:34.809673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.810548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.813055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.820318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80910c-7d6d-4c6f-851b-09886ade3b65 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.825696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.826328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.826657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.826973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.827716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.828014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.829674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.832538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:34.834556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 367/737] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:34.837643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 371/738] 10.222.0.42 () {56 vars in 1145 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:34.842294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.845025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.852482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e99766-5376-494d-aa88-7024cb9ff27b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.855934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba66d-5954-474b-a489-b1a60eb43fa4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.857491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.858239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.858614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.859532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.860375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.860770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.862387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.862569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.863323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.863811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.864235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.865199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.866374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:41:34.866374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:41:34.866374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:41:34.867515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.876251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 368/739] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:34.883598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.895001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6c46-2ac2-4fcd-b10a-63aca45c33ea admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.897105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 372/740] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:34 2021] POST /identity/v3/endpoints => generated 346 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:34.920480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.922189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.922612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.923020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.931647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.934051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.950739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:34.952759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 369/741] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:34.959701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:34.971508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bad11-a16b-43cb-81ae-cb0ad187e8ab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:34.976444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:34.977484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:34.977949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:34.978376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:34.979428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:34.979902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:34.982126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3617db-de65-41e5-afe9-e14976ef00fd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:34.997797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 373/742] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.004978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.016688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa29a1-b54c-4b85-a3a6-6518b3b6f1b0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.022000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.022895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.023320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.023805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.024866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=a14e56830d1145278d5012377b283e4d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:35.025415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.028041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c26952-ae9d-4e10-8b7e-f106cee68ffd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.041261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 370/743] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/role_assignments?user.id=a14e56830d1145278d5012377b283e4d&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.281186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71358-0502-41b7-97d8-1795d00d9a2a None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.281556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71358-0502-41b7-97d8-1795d00d9a2a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.281767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71358-0502-41b7-97d8-1795d00d9a2a None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.283809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 374/744] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:35.289991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.290281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.290557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.311395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:35.313184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:35.323023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 371/745] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:35 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:35.346928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71358-0502-41b7-97d8-1795d00d9a2a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.359879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71358-0502-41b7-97d8-1795d00d9a2a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.364532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.365361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.365641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.365914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.366587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.368188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.380581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:41:35.382182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 375/746] 10.222.0.42 () {56 vars in 1153 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:35.388723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.397767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70dfd62-4727-4d77-a457-566a1c9cfaa3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.402405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.403060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.403394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.403673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.404394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:35.404697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.406901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd2b05-70fb-4187-8857-1a4fb1b7939c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.411897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 372/747] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.418163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.428792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff86b4-f472-4f4b-b706-75be319f71ed admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.433745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.434411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.434690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.434961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.435690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:35.435994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.437883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692df0-62c3-46ac-905f-3c9098166390 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.444574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 376/748] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.716663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5cf01-8a61-494b-b0be-788ba644967a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.717045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5cf01-8a61-494b-b0be-788ba644967a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.717354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5cf01-8a61-494b-b0be-788ba644967a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.719454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 373/749] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:35.725682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.726079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.726450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.744788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:35.746133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:35.756495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 377/750] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:35 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:35.780808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5cf01-8a61-494b-b0be-788ba644967a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.793096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5cf01-8a61-494b-b0be-788ba644967a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.798050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.798835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.799111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.799382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.810691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:35.818296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:35.824735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 374/751] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:35.826638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.836034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5fe8e-4d24-4bf3-9426-ef9796b4204e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.840600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.841287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.841567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.841841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.842596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:35.842898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.844534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.857061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 378/752] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.860508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.870822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566795d-b0cb-4a2a-8055-34c8bbf8a164 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.875999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.876779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.877109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.877386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.888046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.889945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.909311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:35.910830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 375/753] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:35.916994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.927625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c947-4546-4f8d-9913-14d42c1ec8ba admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.932202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.932854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.933228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.933506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.934288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:35.934594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.936236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.953361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 379/754] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:35.956125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:35.966337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf144a0-b1e0-49e5-9efd-6499be270359 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:35.971772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:35.972557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:35.972832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:35.973183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:35.981169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:35.983311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:35.997539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:41:36.004490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 376/755] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:36.005888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.017063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0c2e-d072-44e3-89f4-59752f332147 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.021730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.022397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.022676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.022949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.023849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:36.024165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.026320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.049086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 380/756] 10.222.0.42 () {56 vars in 1156 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:36.051682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.061782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e9bc-3eea-49b5-b93f-13ba13e40b23 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.066440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.067300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.067580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.067901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.076250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.078698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.093685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 377/757] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:36.095232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.105384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197929-2523-41a1-a9c3-fed253a2682f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.112450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.113279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.113600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.113870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.125520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.127373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.145205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:36.146915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 381/758] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:36.153172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.162900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7cac-badd-4d2c-98f2-1c17026af537 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.167709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.168356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.168630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.168900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.169685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:36.170005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.172249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.189077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 378/759] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:36.191247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.201468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091b19-2fb1-4705-b726-96b0ca5c6de3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.206696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.207484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.207761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.208035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.215492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.217689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.232430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:36.237450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 382/760] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:36.240803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.251508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d844-cb98-4b67-b53c-ea9b9c5e9f93 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.256396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.257138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.257421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.257696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.258552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:36.258859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.261850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57026821-585b-4301-96a2-d8bd4c27ac84 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.281080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 379/761] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:36.282804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:36.293679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbe35-34cc-4815-9b63-5deca3bfff1f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:36.298442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:36.299139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:36.299417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:36.299687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:36.300580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=e3be860ad77f429ab00e7ce038b7c735) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:36.300886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:36.302801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee7e8-22a0-4cb6-ad98-0bfb793a902e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:36.313428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 383/762] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:36 2021] GET /identity/v3/role_assignments?user.id=e3be860ad77f429ab00e7ce038b7c735&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:37.337553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4044b0-cae2-4259-8fcc-5ffb4ef549d6 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.338101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4044b0-cae2-4259-8fcc-5ffb4ef549d6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.338101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4044b0-cae2-4259-8fcc-5ffb4ef549d6 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.340216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 380/763] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:37.346250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726551-0426-4c5b-8f6d-996eceb39240 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.346677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726551-0426-4c5b-8f6d-996eceb39240 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.346769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726551-0426-4c5b-8f6d-996eceb39240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.365151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-20726551-0426-4c5b-8f6d-996eceb39240 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:37.366329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-20726551-0426-4c5b-8f6d-996eceb39240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:37.374267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 384/764] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:37 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:37.400222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4044b0-cae2-4259-8fcc-5ffb4ef549d6 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.413483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699170-b3fa-4afd-96a2-4a7e58ace188 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.413668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4044b0-cae2-4259-8fcc-5ffb4ef549d6 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.413748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699170-b3fa-4afd-96a2-4a7e58ace188 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.414024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e699170-b3fa-4afd-96a2-4a7e58ace188 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.416065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 385/765] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:37.417947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.418736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.419011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.419278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.419948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.421897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.422491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.422775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.423049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.434926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:41:37.441032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 381/766] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:37.443568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.445307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:37.446480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:37.454253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86ad6-f9b2-474a-bb4c-84c661592f9f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.454715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 386/767] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:37 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:37.460977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.461671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.461946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.462214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.462929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.463288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.464910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.470579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 382/768] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:37.476790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.481994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.487137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb900-0fd7-488b-a5c6-932e1a8e7449 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.492208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b0532-a56f-4099-8385-e701bb704e0b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.492467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.493259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.493521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.493885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.494785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.495179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.496692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.497134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.497516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.497791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.498061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.506674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 387/769] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:37.514796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:37.523067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:41:37.524729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 383/770] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:37.531723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.541917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f145e-0728-4a06-9fbc-c81b4a40d0e6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.546714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.547391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.547666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.547938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.548712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.549046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.550680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.560054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 388/771] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:37.566492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.577034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487d524-7a95-478c-b0ea-30cf19fd83df admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.582534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.583347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.583626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.583893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.596756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.598775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.617190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:37.618770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 384/772] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:37.625768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.636070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d260f5-fb51-403d-9750-7851e11efbf6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.641540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.642271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.642544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.642814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.643624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.643929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.646077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.664717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 389/773] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:37.670822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.681492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff1e9-71ff-4e70-b498-69fbd956aec0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.686409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.687810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.688086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.688407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.699153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.701357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.720049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:37.722332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 385/774] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:37.729668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.741771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffe8a8-7591-40f7-b9e0-5ea2c0d0246b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.747372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.748041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.748317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.748586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.750001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.750305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.752305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.772331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 390/775] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:37.778602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.788602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff677ac-d9d5-4aa3-a0a8-03a290602e60 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.793289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.793978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.794254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.794572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.802907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.804749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0cb1c-c616-4276-afd4-5e7918fb4010 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.814720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 386/776] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:37.820804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.824105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681982-6aed-4a4f-9b5c-43667b60146c None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.824397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681982-6aed-4a4f-9b5c-43667b60146c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.824715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff681982-6aed-4a4f-9b5c-43667b60146c None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.826675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 387/777] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:37.831432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f56aa-c808-467c-a04b-676dc810c459 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.833007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.833300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.833577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.836154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.836935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.837279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.837546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.852257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.854189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.855258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:37.856622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:37.865014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 388/778] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:37 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:37.872361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:37.873865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 391/779] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:37.880623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.890964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.894056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dd8a3-d8db-4155-89ca-917a062b8c87 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.899093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.899984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.900562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.901043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b4ca-e122-4f7f-a6dc-9b71d88b0933 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.901302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.902508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:37.903076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.905133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.905562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.906204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.906480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.906749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.907482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.909762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.920030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 389/780] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:37.926752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:37.935726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 392/781] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:37 2021] POST /identity/v3/services => generated 269 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:37.943922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6102-38e4-440f-a2ae-7f2dd9f182cd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:37.961924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:37.963196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:37.963730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:37.964200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:37.972881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:37.975266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:37.991314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:37.993342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:38.001240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:38.014305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4ce8-4b0b-488f-8687-e8cdb0bfb9fe admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:38.019397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:38.020559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.021061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.021562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.022561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:38.023114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:38.025384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3022a1e-60b0-4173-8ea8-3ab5c739711f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:38.045386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 393/783] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:38.049615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:38.060906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3a209-08de-4f9e-bc1b-c9922a32ddf2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:38.066798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:38.067824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.068346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.068815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.069990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] RBAC: Adding query filter params (role.id=f3d1b653f83b487c986208ea54d23750, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=a14e56830d1145278d5012377b283e4d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:38.070515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:38.072703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31c32-d732-4004-9bfb-67138ebe2661 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:38.079765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 391/784] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:38 2021] GET /identity/v3/role_assignments?user.id=a14e56830d1145278d5012377b283e4d&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=f3d1b653f83b487c986208ea54d23750 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:38.714304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8d4-717d-482d-82c8-efc9b3713a8b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.714822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8d4-717d-482d-82c8-efc9b3713a8b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.714928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07b8d4-717d-482d-82c8-efc9b3713a8b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.716925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 394/785] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:38.723765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.724195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.724368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.743027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:38.744227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:38.757091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 392/786] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:38 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:38.776983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b8d4-717d-482d-82c8-efc9b3713a8b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:38.790113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07b8d4-717d-482d-82c8-efc9b3713a8b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:38.794578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:38.795372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.795651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.795919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.796618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:38.798261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:38.809668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:41:38.816594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 395/787] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:38 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:38.817953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:38.827138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022a8ac-add0-4979-a759-8b4781949830 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:38.832157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:38.832820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.833141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.833418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.834138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:38.834443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:38.836057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b23f6-3491-4bad-a735-87ebbb89be23 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:38.845066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 393/788] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:38 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:38.848310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:38.858143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a0f7-43a6-433e-82b3-84df854b738a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:38.862806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:38.863456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:38.863739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:38.864014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:38.864734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:38.865082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:38.866667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0338e0-0180-491e-a367-32ab5c9d0d0e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:38.877092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 396/789] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:38 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:39.852495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f71-8493-4535-ad00-d0913dc1731d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:39.853237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f71-8493-4535-ad00-d0913dc1731d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:39.853237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330f71-8493-4535-ad00-d0913dc1731d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:39.855075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 394/790] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:39.861447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee103-62ab-4821-b89c-36a456087d86 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:39.861981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee103-62ab-4821-b89c-36a456087d86 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:39.861981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee103-62ab-4821-b89c-36a456087d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:39.880142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-64cee103-62ab-4821-b89c-36a456087d86 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:39.881371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-64cee103-62ab-4821-b89c-36a456087d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:39.889547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 397/791] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:39 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:39.913249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330f71-8493-4535-ad00-d0913dc1731d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:39.925864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330f71-8493-4535-ad00-d0913dc1731d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:39.930651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:39.931565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:39.932054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:39.932535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:39.933530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:39.935310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b14737-6392-4a3c-88b2-e23c5b9542e2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:39.954607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 395/792] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:39 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:40.355146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483e81-e998-4780-8aa1-ad4c6a7882da None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.355467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483e81-e998-4780-8aa1-ad4c6a7882da None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.355704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13483e81-e998-4780-8aa1-ad4c6a7882da None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.357808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 398/793] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:40.363934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cc67-6f1d-4b88-b0f1-e680681e470b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.364220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cc67-6f1d-4b88-b0f1-e680681e470b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.364499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cc67-6f1d-4b88-b0f1-e680681e470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.382470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5df5cc67-6f1d-4b88-b0f1-e680681e470b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:40.383650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5df5cc67-6f1d-4b88-b0f1-e680681e470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.404508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 396/794] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:40 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:40.418587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c424-698b-4dd8-92cb-8e86b813f096 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.419178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c424-698b-4dd8-92cb-8e86b813f096 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.419668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c424-698b-4dd8-92cb-8e86b813f096 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.422173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 399/795] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:40.428911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.429408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c424-698b-4dd8-92cb-8e86b813f096 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.429722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.430209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.442890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c424-698b-4dd8-92cb-8e86b813f096 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.447346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.448203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.448489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.448760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.449501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.451065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:40.451174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.452577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.461659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 397/796] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:40 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:40.466110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:41:40.466110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 400/797] 10.222.0.42 () {56 vars in 1153 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:40.471512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.481155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fe6c1-d339-4d03-be9f-46aaa06fff63 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.486590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.487470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.487944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.488715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.489594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.489878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.490368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.492119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.498472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 398/798] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.499113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3b05-f9c2-4a50-aea9-563170b40176 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.505354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.506579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.507785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.509320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.509608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.518614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9738ab-2cce-4ceb-a292-1d3219102c58 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.521079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:40.523808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.524736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.525235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.525717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.526604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.527110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.528788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:41:40.529083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.534555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 399/799] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:40.537097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 401/800] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:40.540581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.541740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.552357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272251d4-1217-48ff-99c8-71c5263f836c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.556674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d328-0f07-4349-b2f0-50f6deb90473 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.557150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.557787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.558072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.558342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.559168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] RBAC: Adding query filter params (interface=public, service_id=ea5f3e56c917480cad419728e63fe738, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.559420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.561004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.563895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.564826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.565339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.565812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.566805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.571816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 400/801] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/endpoints?service_id=ea5f3e56c917480cad419728e63fe738&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.571962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.571962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.573337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.581272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 402/802] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.585072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21076-4cb5-4ca4-a877-dde4356f1781 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.587858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.591164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.592013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.592473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.592880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.594557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.597267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.599478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638aef3-3a23-4e00-990d-777ac24ac13a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.604059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.604669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 401/803] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/services => generated 1268 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:40.609711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.610227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.610666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.623117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.625799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.645562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:40.647581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 403/804] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:40.653678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.664475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f082c-8d3f-4e51-93fc-a38c85db8c05 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.669519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.670313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.670667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.671129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.672489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.672867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.674725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.687851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 402/805] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.694161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.705881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f777f3-9e2a-4cab-8b12-6d4a22c517c0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.710639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.711468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.711745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.712012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.720881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.722957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.739026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:40.740619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 404/806] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:40.746769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.759139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b400e63-b6d5-4461-9015-88a8c058d1f4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.763863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.764545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.764867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.765173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.766034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.766340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.768205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.788457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 403/807] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.794884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.805634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dbcf-ccfd-4d2b-9408-ecb40f2cedee admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.810372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.811106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.811380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.811692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.823121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.825122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.844809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:40.845546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 405/808] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:40.852755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.863448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d2b3f-22d5-4d9a-a7fb-c3052972a03f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.868934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.869615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.869889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.870154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.870887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.871182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.872773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.885479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 404/809] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:40.891541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.901907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc575-a542-45c5-bf97-5c087207ef8b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.907469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.908334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.908620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.908895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.916681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.918818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.933529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:40.935100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 406/810] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:40.941737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.954356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b722-2ede-462a-abd4-95d6b4ce04af admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.958762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.959395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.959670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.959941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.960725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:40.961055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.962880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1be830-bf40-45cf-9de7-4e1e2accb443 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.976931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 405/811] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:40.983365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.994752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c0569-70b5-4371-b254-76763f3cc1f5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.999797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:41.001078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:41.001579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:41.002050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/a14e56830d1145278d5012377b283e4d/roles/f3d1b653f83b487c986208ea54d23750` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:41.005031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=a14e56830d1145278d5012377b283e4d, role_id=f3d1b653f83b487c986208ea54d23750)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:41.008093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d292a8-1f51-47cc-9dcd-6f4652fe054a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:41.024499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 407/812] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:40 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/a14e56830d1145278d5012377b283e4d/roles/f3d1b653f83b487c986208ea54d23750 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:41:41.213076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf68a8-f1a8-474f-967f-759b3f22149f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:41.213442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf68a8-f1a8-474f-967f-759b3f22149f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:41.213728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf68a8-f1a8-474f-967f-759b3f22149f None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:41.215981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 406/813] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:41.223775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d62-154d-4de8-92d4-ced47a04b438 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:41.224090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d62-154d-4de8-92d4-ced47a04b438 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:41.224331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9d62-154d-4de8-92d4-ced47a04b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:41.247484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0b7f9d62-154d-4de8-92d4-ced47a04b438 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:41.248685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0b7f9d62-154d-4de8-92d4-ced47a04b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:41.313157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 408/814] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:41 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:41.333501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf68a8-f1a8-474f-967f-759b3f22149f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:41.347303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf68a8-f1a8-474f-967f-759b3f22149f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:41.351737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:41.352390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:41.352667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:41.352938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:41.353733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:41.355323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dadb95-1cc7-4316-995f-8977c9e1874f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:41.373330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 407/815] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:41 2021] POST /identity/v3/services => generated 241 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:42.327293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1b21-a0cb-43ba-89df-d935ef62f3e6 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.328281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1b21-a0cb-43ba-89df-d935ef62f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.328771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd1b21-a0cb-43ba-89df-d935ef62f3e6 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.332480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 409/816] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:42.338310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.338757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.338845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.356991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:42.358184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:42.376096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 408/817] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:42 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:42.402005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1b21-a0cb-43ba-89df-d935ef62f3e6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:42.414987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd1b21-a0cb-43ba-89df-d935ef62f3e6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:42.419569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:42.420360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.420687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.421048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.422224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:42.423859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:42.435777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:41:42.437862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 410/818] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:42 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:42.444428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:42.454233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c5c3-b1a3-428e-9c58-3859e06b1351 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:42.458742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:42.459409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.459686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.459957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.460670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:42.460991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:42.462582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:42.468427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 409/819] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:42 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:42.474652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:42.485087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a4b7-1d9e-4191-ada4-1f2eda768c4f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:42.489631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:42.490287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.490569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.490843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.491558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:42.491864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:42.493467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:42.498776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 411/820] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:42 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:42.505443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:42.515990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f4a8-6da2-42d9-b99e-bf01bab03082 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:42.520553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:42.521234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.521512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.521783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.522655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] RBAC: Adding query filter params (interface=public, service_id=21a6d8650cd347a9a7df48111fd90218, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:42.522964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:42.524649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34b34-2bf8-4382-9a3a-3076702bfe3d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:42.531669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 410/821] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:42 2021] GET /identity/v3/endpoints?service_id=21a6d8650cd347a9a7df48111fd90218&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:42.537792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:42.547705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135c9f-7b94-4808-a124-99b2dbcfdb01 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:42.552361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:42.553123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:42.553408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:42.553686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:42.554426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:42.556082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a873b3e-bdb7-4530-8fdd-2144cf27d9ca admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:42.562887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 412/822] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:42 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:43.026646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddedbe-74d6-452b-ab03-036e9f85f339 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.027100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddedbe-74d6-452b-ab03-036e9f85f339 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.027457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddedbe-74d6-452b-ab03-036e9f85f339 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.029339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 411/823] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:43.036017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.036306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.036587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.055060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:43.056242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.064286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 413/824] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:43 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:43.088270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddedbe-74d6-452b-ab03-036e9f85f339 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.101318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddedbe-74d6-452b-ab03-036e9f85f339 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.106006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.107024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.107544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.108016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.109481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.111262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.122944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:41:43.129096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 412/825] 10.222.0.42 () {56 vars in 1153 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:43.132093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.141735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f858d19-de06-466e-83ea-17fe23c6590c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.146782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.147788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.148326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.148798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.149752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.150280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.152087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.163334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 414/826] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.164863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.175285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8cb9-41c5-49dd-837b-2a28be237aa8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.180108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.181027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.181602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.182090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.183002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.183516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.185332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b25c-13d7-4013-9300-aa51bc9d326c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.195684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 413/827] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.197242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.207269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c390c-67fa-48c6-8766-667481f8465c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.212118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.213098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.213587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.214118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.215192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.217052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4c07-6be8-48e2-bd87-45b83faa9b20 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.245159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 415/828] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:43 2021] POST /identity/v3/endpoints => generated 347 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:43.381110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2388c-951e-4594-b026-2fcbae7de45a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.381622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2388c-951e-4594-b026-2fcbae7de45a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.381622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2388c-951e-4594-b026-2fcbae7de45a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.383641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 414/829] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:43.390685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.391174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.391245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.410509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:43.411750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.431507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 416/830] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:43 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:43.458224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2388c-951e-4594-b026-2fcbae7de45a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.471336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2388c-951e-4594-b026-2fcbae7de45a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.475764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.476559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.476837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.477136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.488049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:43.495503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:41:43.497016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 415/831] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:43.503762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.513206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d1ee8-16bd-4c16-832b-dbc432a8b78b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.518812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.519584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.519862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.520131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.520891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.521220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.522818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.532588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 417/832] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.538883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.549301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee5ef7-abcd-4431-b2eb-dad270a61158 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.553914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.554705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.554985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.555274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.566101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.567870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.585830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:43.587530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 416/833] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:43.595198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.607175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f757ed6-5ad8-4ff9-bce2-33d71b24a99e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.612449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.613475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.613968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.614416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.615351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.615836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.617711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.632239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 418/834] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.638705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.649377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c69a-b745-4438-9ed0-357aaee7568c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.654204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.655311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.655795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.656248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.664143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.666398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.681258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:41:43.683105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 417/835] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:43.690304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.700578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c047-b6c4-498f-b38e-ceeb338aa7ba admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.706261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.707133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.707625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.708072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.709126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.709611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.711648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf489b5-c57b-49b4-bdf0-d453084496cc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.731837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 419/836] 10.222.0.42 () {56 vars in 1170 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.738910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.745251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df87079-c3c7-45b4-8cb5-efdb7b2449b6 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.745540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df87079-c3c7-45b4-8cb5-efdb7b2449b6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.746341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df87079-c3c7-45b4-8cb5-efdb7b2449b6 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.747889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 420/837] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:43.750174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4a24-2a3b-4479-bdd7-08f7f562e52c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.754177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.754521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.754801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.755835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.756763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.757245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.757696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.767236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.769689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.774391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:43.775619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.780190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 418/838] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:43.788926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 421/839] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:43 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:43.790050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.801017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e575ec-f34a-464b-ab14-65754a1b00b0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.807377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.808764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.809190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.809470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.814646 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.820727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.823283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.823590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0618-5927-4dab-9d7a-a8ea02f3da8e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.828529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.829361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.829640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.829918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.830686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.832414 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.843565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:43.844480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:41:43.845123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:43.849882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 422/841] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:43.852266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.857045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.863822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64478c-c9a9-4df8-81b7-857bbcc4cce9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.867074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca3e2-c692-4a43-9b2e-732a4a91327c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.868707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.869561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.869845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.870210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.871131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.871538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.871829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.872554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.872837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.873139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.873300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.873913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.874253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.875897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.881471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 423/842] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:43.887679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.894473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 420/843] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:43.901553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.903760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1dd38-6aac-41ac-9c31-0e781726c312 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.910130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.911044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.911551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.911940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859e6d-ba01-49b5-99bd-c4e8362cc2be admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.912245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.913310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.913968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.916134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.917101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.917989 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.918404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.918744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.929154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 424/844] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:43.930223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.931264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.932484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.942437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535831b-bfd5-473d-bbf9-f512251ac6ec admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.947151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:43.947550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.948423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.949644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 421/845] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:43.949755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.949755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.954352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] RBAC: Adding query filter params (interface=public, service_id=1fda6e9de5284fe597dcf1d1dc384924, region_id=RegionOne) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.954352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.954352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.955997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.967547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 425/846] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/endpoints?service_id=1fda6e9de5284fe597dcf1d1dc384924&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.969940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.971702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2481e-b3c6-4231-9059-1e327dcf46a3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.976573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.977653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.977653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.977934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.978701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.979354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.981334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.982059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc515-246e-4db8-b769-254658369ee0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.987979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.988872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.989831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.990325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.991207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.993649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87099c-e3d0-4344-938c-9148236c00a2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.995038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 422/847] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:44.003468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:44.008249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 426/848] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/services => generated 1497 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:44.013727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705ac4-a8dc-4eb1-b31a-1527e581e5fc admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:44.019489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:44.020257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:44.020545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:44.020824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:44.021820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] RBAC: Adding query filter params (role.id=f3d1b653f83b487c986208ea54d23750, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=a14e56830d1145278d5012377b283e4d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:44.022196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:44.024231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af56-690b-4aa7-a2b9-cc1b6c8a41ca admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:44.032330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 423/849] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:44 2021] GET /identity/v3/role_assignments?user.id=a14e56830d1145278d5012377b283e4d&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=f3d1b653f83b487c986208ea54d23750 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:44.905882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312c8d-3d50-4b4d-a274-b8f8fe20c110 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:44.906418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312c8d-3d50-4b4d-a274-b8f8fe20c110 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:44.906418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7312c8d-3d50-4b4d-a274-b8f8fe20c110 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:44.908476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 427/850] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:44.914541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:44.915010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:44.915089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:44.938524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:44.939712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:44.947956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 424/851] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:44 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:44.972007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7312c8d-3d50-4b4d-a274-b8f8fe20c110 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:44.985378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7312c8d-3d50-4b4d-a274-b8f8fe20c110 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:44.990221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:44.991257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:44.991757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:44.992250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:44.993228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:44.995020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.007973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:41:45.013058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 428/852] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:44 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:45.016385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.025491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d769f-e64c-4172-a4d6-60a5b9fbaeba None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.030126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.030833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.031115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.031391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.032117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:45.032423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.034055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.044386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 425/853] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:45.045777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.056685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6029d-e68b-4b7b-afe1-fb87c0c76bca admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.061311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.062601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.062882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.063162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.063890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:45.064198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.065889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2061b2-35ae-4a6c-8c5a-67679239a423 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.078180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 429/854] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:45.079235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.088978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e44e8-6da1-4df0-8990-fe6ef7af5690 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.094096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.094811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.095101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.095374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.096140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.097761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb625f6-1e43-4ff3-99ea-cc988b2abfdf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.125161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 426/855] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:45 2021] POST /identity/v3/endpoints => generated 346 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:45.645483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90bf7-7a36-4135-9ac9-5d82ba083e27 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.645846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90bf7-7a36-4135-9ac9-5d82ba083e27 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.646040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90bf7-7a36-4135-9ac9-5d82ba083e27 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.647945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 430/856] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:45.654062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.654350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.654641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.672695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:45.673904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:45.690592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 427/857] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:45 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:45.714154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d90bf7-7a36-4135-9ac9-5d82ba083e27 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.727002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d90bf7-7a36-4135-9ac9-5d82ba083e27 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.731388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.732159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.732534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.732788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.733531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.735126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.746148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:41:45.747608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 431/858] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:45.754479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.763398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758d64-bf77-4d53-8097-9386462754b1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.768592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.769337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.769622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.769889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.770605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:45.770904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.772489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746228b-782b-4729-993a-bc998f5e2214 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.777601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 428/859] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:45.784338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.794145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a497c-bb4a-49a1-8db5-2cd13c408c92 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.798806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.799452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.799731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.800002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.800823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:45.801162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.802805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98939-15c7-4872-8dbc-b706624567f9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.807715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 432/860] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:46.409745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f135-3818-499a-bdf9-4c382db0d8e7 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.410315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f135-3818-499a-bdf9-4c382db0d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.410315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f135-3818-499a-bdf9-4c382db0d8e7 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.412351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 429/861] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:46.418574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a499-33db-45b2-bd3f-8fb591069a9e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.419047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a499-33db-45b2-bd3f-8fb591069a9e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.419132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a499-33db-45b2-bd3f-8fb591069a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.441430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-99b2a499-33db-45b2-bd3f-8fb591069a9e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:46.442625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-99b2a499-33db-45b2-bd3f-8fb591069a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:46.450840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 433/862] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:46 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:46.474553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f135-3818-499a-bdf9-4c382db0d8e7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.484233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a41a-f57b-444a-a9c3-669340f0cb8a None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.484599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a41a-f57b-444a-a9c3-669340f0cb8a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.484939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43a41a-f57b-444a-a9c3-669340f0cb8a None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.486990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 434/863] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:46.488404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f135-3818-499a-bdf9-4c382db0d8e7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.492677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.492972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.493269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.493385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.494159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.494509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.494848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.495781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.497557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.512712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:46.513985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:46.514180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:41:46.515686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 430/864] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:46.522910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.524879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:46 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:46.533175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd157cc-1d02-4eda-a972-631d42ce63c2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.537884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.538535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.538816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.539135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.539969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:46.540270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.541902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.548873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 431/866] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:46.549939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.555357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.559541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983645ce-3ea7-44ca-851e-93c1312683cb None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.565716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.566306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d442c0-26a6-47aa-b427-c6f1ddf1c93e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.566658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.567109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.567445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.568308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.570179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.570956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.571599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.571882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.572343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.573435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:46.573754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.575629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.581767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 432/867] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:46.583341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:41:46.584609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 436/868] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:46.590340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.591721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.603325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd1029-cf4b-4383-a57d-d9f84f165142 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.604168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d77d97-9881-4571-a7cf-b8697767d608 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.608304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.609103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.609269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.609508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.609867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.610020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.610241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.610519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.610816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] RBAC: Adding query filter params (name=image) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:46.611255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.611399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.612980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.613132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53471a83-54fa-406c-90f3-e844bb75ce69 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.621038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 437/869] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:46.625451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:46.638065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce416d4-c61a-4f32-8a28-8216d7d00d3e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:46.643580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:46.644473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:46.644677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 433/870] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:46 2021] POST /identity/v3/endpoints => generated 349 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:46.645177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:46.645670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:46.646589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:46.647103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:46.648975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31073ea4-5c13-472a-958f-495cd9a979c5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:46.654869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 438/871] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:46 2021] GET /identity/v3/services?type=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:47.507246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff74f8-e1c7-4393-a3c3-6fd4e06b278f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:47.507782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff74f8-e1c7-4393-a3c3-6fd4e06b278f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:47.507782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff74f8-e1c7-4393-a3c3-6fd4e06b278f None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:47.510232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 434/872] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:47.518740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:47.519670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:47.520137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:47.538001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:47.539517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:47.561122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:47 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:47.582282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff74f8-e1c7-4393-a3c3-6fd4e06b278f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:47.595521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff74f8-e1c7-4393-a3c3-6fd4e06b278f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:47.600660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:47.601596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:47.602100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:47.602575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:47.603555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:47.605619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:47.607183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.common [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 16:41:47.626410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.sql.core [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 16:41:47.626410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 16:41:47.626410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [parameters: {'id': '255e994c678e48ecab2a6ce5c2d540c2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 16:41:47.626410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73567) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:41:47.633979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 255e994c678e48ecab2a6ce5c2d540c2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 255e994c678e48ecab2a6ce5c2d540c2. Oct 12 16:41:47.641028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 435/874] 10.222.0.42 () {60 vars in 1161 bytes} [Tue Oct 12 16:41:47 2021] POST /identity/v3/projects => generated 262 bytes in 54 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:47.643394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:47.652680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6dbed-85e2-4a96-94cf-12a2f8a2a280 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:47.657823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:47.658829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:47.659302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:47.659777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:47.667165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:47.669583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:47.683848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-bd53126c-bb4b-4d1c-ac3c-233aff9bfb4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:47.689222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 440/875] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:47.693363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:47.704437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a614a06-2114-4317-ac3a-c8bb0e51895a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:47.709293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:47.710221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:47.710695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:47.711172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:47.712132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:47.712624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:47.714978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cf5e-caf6-41f4-81c6-aec5d75b370b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:47.741354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 436/876] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:47 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:48.148861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e882-365f-40db-a390-10007a3aec22 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.149553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e882-365f-40db-a390-10007a3aec22 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.150103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e882-365f-40db-a390-10007a3aec22 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.153293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 441/877] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:48.163839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61615-569b-4852-b977-e49bc6e9e336 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.164259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61615-569b-4852-b977-e49bc6e9e336 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.164632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61615-569b-4852-b977-e49bc6e9e336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.184477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e6c61615-569b-4852-b977-e49bc6e9e336 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:48.186022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e6c61615-569b-4852-b977-e49bc6e9e336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:48.194327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 437/878] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:48 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:48.220103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e882-365f-40db-a390-10007a3aec22 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:48.233240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e882-365f-40db-a390-10007a3aec22 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:48.238258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:48.238900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.239179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.239449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.240187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:48.241797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5046-31f9-4695-b95c-dc278807bfba admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:48.258555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 442/879] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:48 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:48.994753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e033b1-0622-4145-90a8-0ab05592fe0a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.995489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e033b1-0622-4145-90a8-0ab05592fe0a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.995489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e033b1-0622-4145-90a8-0ab05592fe0a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.997652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 438/880] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:49.004763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cd87-195c-4c9a-beb8-13da4cab0b5e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.005435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cd87-195c-4c9a-beb8-13da4cab0b5e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.005435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cd87-195c-4c9a-beb8-13da4cab0b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.023613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f8c6cd87-195c-4c9a-beb8-13da4cab0b5e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:49.024810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f8c6cd87-195c-4c9a-beb8-13da4cab0b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:49.042584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 443/881] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:49 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:49.066595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e033b1-0622-4145-90a8-0ab05592fe0a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.079224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e033b1-0622-4145-90a8-0ab05592fe0a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.083667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.084322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.084602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.084875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.085669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.087246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71608-1f24-41f7-b577-36f5c073fb7e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.104635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 439/882] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:49 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:49.105631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076e9-923a-4bbb-ba84-750d15ec33e5 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.105946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076e9-923a-4bbb-ba84-750d15ec33e5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.106229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076e9-923a-4bbb-ba84-750d15ec33e5 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.108032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 444/883] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:49.115730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.116050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.116277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.137685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:49.138919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:49.159180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 440/884] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:49 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:49.184807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385076e9-923a-4bbb-ba84-750d15ec33e5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.198125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385076e9-923a-4bbb-ba84-750d15ec33e5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.203035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.203846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.204128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.204402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.205181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.206817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.219515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:41:49.221105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 445/885] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:49.227976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.238557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8811c-2d23-4bd1-985d-2039b78d232f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.243419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.244102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.244380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.244649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.245487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:49.245734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.247385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.254110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 441/886] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:49.263496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.276459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006315a6-7ae3-4c1a-a446-7398d5754886 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.282112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.282793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.283076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.283347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.284082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:49.284385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.286024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.291964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 446/887] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:49.299453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.309878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d31aa-d602-4f05-8157-fe75d7d3072d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.315427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.316152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.316437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.316714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.317619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] RBAC: Adding query filter params (interface=admin, service_id=1fda6e9de5284fe597dcf1d1dc384924, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:49.317930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.319589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5f921-0e0a-4f50-b5fb-ee4186ce2b39 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.325814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 442/888] 10.222.0.42 () {56 vars in 1270 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/endpoints?service_id=1fda6e9de5284fe597dcf1d1dc384924&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:49.332269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:49.342982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b778e-165f-4895-8e61-8bfbc900f8dc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:49.347597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:49.348255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:49.348539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:49.348815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:49.349542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:49.351133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b1b09-ab22-44d4-bfda-7b3e3c9d8ac5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:49.358827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 447/889] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:49 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:41:50.106395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa60ee-752d-414f-8a03-8abd1644bef7 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.106908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa60ee-752d-414f-8a03-8abd1644bef7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.106908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa60ee-752d-414f-8a03-8abd1644bef7 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.109527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 443/890] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:50.117568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.117568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.117568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.135850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:50.137386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:50.149039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:50 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:50.171699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa60ee-752d-414f-8a03-8abd1644bef7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.184166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa60ee-752d-414f-8a03-8abd1644bef7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.189572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.190460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.190932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.191406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.192317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.194381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.208980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.sql.core [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 16:41:50.208980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 16:41:50.208980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [parameters: {'user_id': '8f2305e2176844bb8ad1ad508dc67a6e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 16:41:50.208980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73567) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:41:50.214808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 16:41:50.216374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 444/892] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:41:50 2021] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:50.222768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.232194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b84d5a-6832-4c0d-8d29-637f56cec1c1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.237680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.238734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.239219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.239702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.248109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.251247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.268639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-ff6e62f4-3716-467a-ba72-e3b8de48165c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:41:50.275833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:50.277737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.288811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30d4ad-883b-4f5d-9a88-1703bff9d8dc admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.293729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.294652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.295141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.295611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.297239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:50.297735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.300015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09c9d9-9402-46b1-a15f-c02a56d603e7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.345123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 445/894] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.619837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55273a-a03b-4d94-b4a4-7a17b55d453b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.620521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55273a-a03b-4d94-b4a4-7a17b55d453b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.621052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55273a-a03b-4d94-b4a4-7a17b55d453b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.623290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 450/895] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:50.630624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.630903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.631396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.653870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:50.655783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:50.664322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 446/896] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:50 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:50.687801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55273a-a03b-4d94-b4a4-7a17b55d453b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.699949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55273a-a03b-4d94-b4a4-7a17b55d453b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.704893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.705699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.705980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.706250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.706911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.708493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.719427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:41:50.720864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 451/897] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:50.727145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.736478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a8b0-7470-4415-a909-90a64cd88826 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.740924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.741591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.741870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.742139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.742850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:50.743161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.744733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.750403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 447/898] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.756497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.766062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952b7a7-7882-44f6-b7d7-2804d9440597 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.770519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.771164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.771437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.771708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.772414 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:50.772717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.774323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.779530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 452/899] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.785806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.795503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4024-4ba9-4e3e-81e9-f3cd42a6e63d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.800728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.801533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.801729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.801999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.802969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] RBAC: Adding query filter params (interface=public, service_id=bc541243514c4202a39559859d8994fa, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:50.803245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.804810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41005d1b-98dc-4de2-8e00-3f947d1555bb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.812975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 448/900] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/endpoints?service_id=bc541243514c4202a39559859d8994fa&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:50.816779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.826371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9756a-be18-46d7-95c1-cba2e10da99f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.830924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.831637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.831986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.832326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.833140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.834786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f996-e9b4-4e24-a47b-711b2da11b98 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.841570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 453/901] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:51.520832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f382a7-62e8-4158-a685-2bd214cc1a9e None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.521377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f382a7-62e8-4158-a685-2bd214cc1a9e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.521452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f382a7-62e8-4158-a685-2bd214cc1a9e None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.523445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 449/902] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:51.529815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.530319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.530519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.550016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:51.551243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:51.559821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 454/903] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:51.584326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f382a7-62e8-4158-a685-2bd214cc1a9e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.597516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f382a7-62e8-4158-a685-2bd214cc1a9e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.602022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.602797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.603079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.603347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] PATH_INFO: `/v3/services/image` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.604004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.605610 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.616845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:41:51.618174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 450/904] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:51.625561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.634904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733902d-3949-49ce-bbd7-7a423a999c25 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.639563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.640290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.640659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.641031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.641818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:51.642188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.643776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2fd63-f4f1-4fd6-98e7-583a3e7d6e73 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.648872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 455/905] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:51.655251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.666337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba5d8-df64-4c04-87ee-1ab8bbbdc7ff admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.671481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.672222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.672569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.672843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.673593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] RBAC: Adding query filter params (type=image) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:51.673896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.675477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc396b-01bc-480e-9737-bf2b71a345dd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.680033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32389c-a86b-49b4-ae21-129529750023 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.680319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32389c-a86b-49b4-ae21-129529750023 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.680592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32389c-a86b-49b4-ae21-129529750023 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.681082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 451/906] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:51.682393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 456/907] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:51.688970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.689270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.689539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.690724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32389c-a86b-49b4-ae21-129529750023 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.703428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32389c-a86b-49b4-ae21-129529750023 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.706902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:51.707947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.708074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:51.708585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.708869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.709157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.710016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] RBAC: Adding query filter params (interface=public, service_id=3337cff8dbdc43ddad0fb50575351d33, region_id=RegionOne) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:51.710333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.711909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.723515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 457/908] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/endpoints?service_id=3337cff8dbdc43ddad0fb50575351d33&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:51.723698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 452/909] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:51.724535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.734647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87701-09f0-48fc-b3de-09253c726f5c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.739316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.740022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.740297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.740570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.740740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.741289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.742872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.750368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944d4d-0be8-4780-bb15-3afd9cc56bda None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.750658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 458/910] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:51.755936 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.757119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.757632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.758118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.759016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.761244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.774008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:41:51.776001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 453/911] 10.222.0.42 () {56 vars in 1147 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:51.783267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.793583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8eb0c-bde3-455c-8c7d-526bfc5391a8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.799060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.799718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.799997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.800268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.801149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:51.801343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.802952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.808701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 459/912] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:51.815990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.825910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4eb864-c951-4c1d-9391-c18f419329f9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.830803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.831478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.831853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.832026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.832744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:51.833083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.834682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136793-c695-4d34-8613-ff5a5d8e90c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.840374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 454/913] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Oct 12 16:41:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:51.847558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:51.857344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cde83-5566-4413-b473-b15144b76009 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:51.862844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:51.863501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:51.863780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:51.864052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:51.864821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:51.866492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c94db-a7c2-4f4d-aa91-9bfa829d9c19 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:51.883828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 460/914] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:51 2021] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:41:53.100185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448971d-c5bb-4e5d-a975-fb997039b4aa None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.100702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448971d-c5bb-4e5d-a975-fb997039b4aa None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.100702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448971d-c5bb-4e5d-a975-fb997039b4aa None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.102525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 455/915] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:53.108741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.109265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.109351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.126607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:53.127804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:53.146889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 461/916] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:53 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:53.172023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448971d-c5bb-4e5d-a975-fb997039b4aa None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.183995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448971d-c5bb-4e5d-a975-fb997039b4aa None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.188307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.189116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.189396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.189667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.190325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.191902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.203330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:41:53.204497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 456/917] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:53.211011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.220484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baf267-9c93-4fc5-b16e-bc95bc64c10c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.225016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.225666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.225947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.226218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.226932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:53.227236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.228826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.234279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 462/918] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:53.240389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.251156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e38228-55c0-428f-8e48-558bcf082111 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.256001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.256646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.256931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.257249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.257964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:53.258268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.262555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401a068-0e85-40af-83ce-8dc2eb90ad13 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.266700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 457/919] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:53.273083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.283026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec670f7e-49c7-4d33-9567-48f8d80a366a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.287566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.288205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.288484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.288757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.289544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.291135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2f411-b0be-4374-913b-6a0a0bf1ff04 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.321181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 463/920] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:53 2021] POST /identity/v3/endpoints => generated 334 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:54.028869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511221-06b3-4d07-9110-fac77810c610 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.029191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511221-06b3-4d07-9110-fac77810c610 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.029468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511221-06b3-4d07-9110-fac77810c610 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.031378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 458/921] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:54.038046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.038382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.038601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.057772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:54.058982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:54.078352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 464/922] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:54 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:54.102429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce511221-06b3-4d07-9110-fac77810c610 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.115610 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce511221-06b3-4d07-9110-fac77810c610 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.120050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.120838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.121226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.121502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.122159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.123728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.135172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:41:54.136513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 459/923] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Oct 12 16:41:54 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:54.142991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.152061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6050b-51f4-4e1b-82a5-a495e4b6064b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.157396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.158124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.158477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.158822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.159616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:54.160008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.161757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124df061-46bb-43bb-a9fa-55dce9f72764 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.167249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 465/924] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:54 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:54.173979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.174483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bcba-2b40-4e80-af50-8bbdb633839b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.174770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bcba-2b40-4e80-af50-8bbdb633839b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.175040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79bcba-2b40-4e80-af50-8bbdb633839b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.176805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 466/925] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:54.182608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.182889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.183158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.184705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b095a-8d47-459f-9113-ccf5c20bea06 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.190903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.191543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.191820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.192087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.192821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] RBAC: Adding query filter params (type=image) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:54.193171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.194807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.199754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 460/926] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:54 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:54.202383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:54.203574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:54.205996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.211646 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 467/927] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:54 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:54.215625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfc3d5-430d-4d6a-ad7b-54320691139d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.220615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.221174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.221444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.221713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.222458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.224006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.236877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.253228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985bfe1-16e4-47b5-9014-431413138e11 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.253431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 461/928] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:41:54 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:54.265046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.265876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.266156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.266431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.267828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.269655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad6741-1a2c-4ea0-b148-a9c4545ad300 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.272996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 468/929] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:54.278726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:54.291029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feff79-058d-4146-9f43-1c4f6188ff30 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:54.296250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:54.296930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:54.297239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:54.297510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:54.298249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:54.300178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650837-f90c-410a-ba23-05237506ef27 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:54.329257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 462/930] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:41:54 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:55.698041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e954-c16a-4f46-8768-33658da178b0 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.698557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e954-c16a-4f46-8768-33658da178b0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.698633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e954-c16a-4f46-8768-33658da178b0 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.700365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 469/931] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:55.706542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.706956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.707118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.725302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:55.726485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:55.782827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 463/932] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:55.808686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4e954-c16a-4f46-8768-33658da178b0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.821019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4e954-c16a-4f46-8768-33658da178b0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.826446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.827272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.827552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.827827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.838262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:55.846370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:41:55.847721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 470/933] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:55.854379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.863863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee4f75-197b-4e7e-b05f-5295436b5334 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.868403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.869089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.869376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.869652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.870411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:55.870720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.872313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.880746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 464/934] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:55.886744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.896769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2e7a-e70b-47ca-bbef-e1a7eb5dcb62 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.901434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.902196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.902477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.902750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.913100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.914934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.932003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:55.933383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 471/935] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:41:55.939591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.949291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade59dd-fb43-4389-a002-93a8c61cbf09 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.953840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.954488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.954765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.955037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.955763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:55.956068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.957685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.970369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 465/936] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:55.976384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.986847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ca10-c09d-4377-b869-4df708b0afb0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.991346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.992120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.992463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.992742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.000200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.002546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.017249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:56.018600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 472/937] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:56.024833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.035167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336048a7-5a47-4ba7-9c81-29cade969319 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.039681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.040337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.040620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.040896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.041784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:56.042095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.043923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.062116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 466/938] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:56.068332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.078780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c6aff-17bf-4726-913e-fd29492f5187 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.083359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.084044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.084344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.084619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.092555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.094851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.103850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 473/939] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:56.110219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.119857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dbd82-cd86-4165-baa4-85390cd8b384 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.124347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.125306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.125585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.125851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.137577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.139986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.170151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:56.171577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 467/940] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:56.177911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.187143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6897fd0-5eb8-4d89-9fe5-4b464f210a00 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.191996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.192775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.193154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.193499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.194312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:56.194684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.196359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.209009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 474/941] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:56.215430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.226100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e426-6563-472a-8a42-5292802d0c93 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.230778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.231576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.231857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.232124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.239763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.241772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.256081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:56.257487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 468/942] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:56.263875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.274662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07484f8c-6105-414e-8781-c19bc51140b3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.279293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.280010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.280796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.281103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.281906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:56.282213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.284108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1dea0-9cb1-4570-a779-e40c008b68d0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.297045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 475/943] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:56.303537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.317031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d55df8-7e87-4f1b-b2d8-6b0aa6e350fa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.321735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.322388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.322669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.322944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.323784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] RBAC: Adding query filter params (role.id=f3d1b653f83b487c986208ea54d23750, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:56.324097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.326013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb924a08-8de8-46cb-b88d-855a1e003e37 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.332762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 469/944] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=f3d1b653f83b487c986208ea54d23750 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:56.566967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9a66-97dd-4e76-9fa6-e6f0af3f2b71 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.567158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9a66-97dd-4e76-9fa6-e6f0af3f2b71 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.567425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9a66-97dd-4e76-9fa6-e6f0af3f2b71 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.569393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 476/945] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:56.575462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2205e-40c9-4463-b78a-a9338d09f8c7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.575747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2205e-40c9-4463-b78a-a9338d09f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.576027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2205e-40c9-4463-b78a-a9338d09f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.594259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-40c2205e-40c9-4463-b78a-a9338d09f8c7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:56.595452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-40c2205e-40c9-4463-b78a-a9338d09f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:56.609156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 470/946] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:56.627848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b9a66-97dd-4e76-9fa6-e6f0af3f2b71 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.640121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b9a66-97dd-4e76-9fa6-e6f0af3f2b71 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.644545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.645217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.645501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.645770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.653906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.656203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.658172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92118198-c635-4cb8-9fed-f9e22099e304 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.658463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92118198-c635-4cb8-9fed-f9e22099e304 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.658750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92118198-c635-4cb8-9fed-f9e22099e304 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.660791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 471/947] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:56.666616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 477/948] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:56.667195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.667559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.667931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.673975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.682607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfeec-7b06-4268-9ed7-419fdea5929b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.687165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:56.687291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.687988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.688267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.688361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:56.688565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.689739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.691402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.693220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 478/949] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:56.697085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 472/950] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:56.723503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.734849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50ca2-37d9-49c9-9d28-77aa917e73e8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.739822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.740634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.740917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.741229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.742610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.744389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0968-c9f7-47e2-a159-e39fb7e253fe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.746373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 479/951] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:56.753584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:56.763488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e72de-a95d-4baa-a7de-ad95560a0bca None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:56.769142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:56.769946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:56.770298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:56.770676 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:56.771584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:56.773757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2351c-cbba-4fbe-9012-1d5599ddeb6f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:56.805065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 473/952] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:41:56 2021] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:41:58.633543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c9425-95c1-43a6-bcf9-e43e1692a14c None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.634035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c9425-95c1-43a6-bcf9-e43e1692a14c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.634035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c9425-95c1-43a6-bcf9-e43e1692a14c None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.635758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 480/953] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:58.642355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.642736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.642908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.660150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:58.661366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:58.669045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 474/954] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:58.693049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c9425-95c1-43a6-bcf9-e43e1692a14c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.705598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c9425-95c1-43a6-bcf9-e43e1692a14c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.709918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.710700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.710972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.711238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.721141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:58.728456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:41:58.729637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 481/955] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:58.736215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.745291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cd065-2cae-469d-8193-bce53312b4e4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.750243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.750890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.751169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.751437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.752190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:58.752496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.754354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.767974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 475/956] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:58.769169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.779064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdeb7-29ee-4645-8d2c-47b54abd1c72 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.783550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.784309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.784584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.784852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.795347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.797246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.814004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:58.815161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 482/957] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:58.821430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.831574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270b-54e9-4334-bb59-d1239423d021 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.836170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.836896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.837209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.837484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.838206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:58.838517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.840090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.852168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 476/958] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:58.858925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.868272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36de7-aa43-4fd6-81de-43647fd0d3a6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.872709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.873512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.873856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.874127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.881406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.883387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.896657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:41:58.897744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 483/959] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:58.903958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.914309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37a1e6-5d64-4b71-8534-de58c1d415a1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.918829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.919491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.919772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.920044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.921535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:58.921839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.923683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.941342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 477/960] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:58.947631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.957990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36ab4-a53f-4c61-b0b4-82a273adb59b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.962401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.963165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.963438 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.963705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.974375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.976270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.994960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:41:58.996243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 484/961] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:59.003763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.013872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004017f-f8b4-4ab6-a87c-01d3e4289d8f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.018492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.019138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.019417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.019698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.020425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:59.020732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.022326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.033812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 478/962] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:59.040099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.050405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cea8c-513a-4c47-aca4-27f56d3b6f9b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.054881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.055651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.055921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.056190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.063678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.065668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.078340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e41e3e1a-a236-4b7b-9b8c-192a227ee2f2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:41:59.079505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 485/963] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:59.085888 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.095593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22759a-fbcf-4d57-9d10-1b5b7b560a6c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.100081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.100717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.101020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.101295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.102143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:59.102455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.104285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.116680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 479/964] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:59.123143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.123264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111b74-c692-4d05-bb5c-8505cee83686 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.123430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111b74-c692-4d05-bb5c-8505cee83686 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.124277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111b74-c692-4d05-bb5c-8505cee83686 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.126078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 486/965] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:41:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:59.132029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.132310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.132582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.133456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e861-e0a2-474a-bb40-6bc2634db5c7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.137861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.138717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.138991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.139298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/f3d1b653f83b487c986208ea54d23750` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.141504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=d0942cb70c474b06a9ea51db2f3298c0, role_id=f3d1b653f83b487c986208ea54d23750)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.144104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.152767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:59.154045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:59.158051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 480/966] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:41:59 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/d0942cb70c474b06a9ea51db2f3298c0/roles/f3d1b653f83b487c986208ea54d23750 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:41:59.215828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 487/967] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:59.241529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.252658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b246-fad9-42e2-b61b-9ecd809a2407 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.257656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.258456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.258737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.259011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.270531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:41:59.277705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:41:59.278991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 481/968] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:41:59.286292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.296010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d654a1f-e4d8-4dae-8a4f-0c7ffbda0330 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.300864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.301574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.301854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.302126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.302908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:59.303214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.304890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.314782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 488/969] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:59.321631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.332280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88a410-2248-4499-bcc4-c7d519619630 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.336987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.337872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.338152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.338425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] PATH_INFO: `/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.353001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] RBAC: Authorizing `identity:get_user(user_id=5d5cd4df19ce4be8b320b8c3dc726ebd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.355290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.357380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 482/970] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:59.364498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.374435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ef99-acc6-4e18-a5ca-7b36a3f18512 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.379274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.379908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.380187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.380460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.388744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.390576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.399396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 489/971] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:59.408032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.419433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0b78-aeb3-4582-bb6e-6979170135ce admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.425039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.425969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.426320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.426661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.427990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.430179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616dc0-196d-4fdb-8647-16f0ed9a293a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.431882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 483/972] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:59.439053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:59.448111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3ed6-3316-4f04-b253-31a8b8c4e87d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:59.452786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:59.453452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:59.453734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:59.454009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:59.454841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=557e8120af564b7e89ab21eedf471cba, user.id=5d5cd4df19ce4be8b320b8c3dc726ebd) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:59.455153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:59.457010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688eb2-dae8-4b90-a816-82ff3cc00b8f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:59.462329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 490/973] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:41:59 2021] GET /identity/v3/role_assignments?user.id=5d5cd4df19ce4be8b320b8c3dc726ebd&scope.project.id=557e8120af564b7e89ab21eedf471cba&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:01.421889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3488fc-f894-4d04-bb69-54a287f099fe None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.422414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3488fc-f894-4d04-bb69-54a287f099fe None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.422414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3488fc-f894-4d04-bb69-54a287f099fe None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.424201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 484/974] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:01.430429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.430903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.430997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.449380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:01.450565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:01.458353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 491/975] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:01.483458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3488fc-f894-4d04-bb69-54a287f099fe None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.495644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3488fc-f894-4d04-bb69-54a287f099fe None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.500758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.501583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.501869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.502143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.512345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:01.519806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:42:01.521098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 485/976] 10.222.0.42 () {56 vars in 1141 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:01.528163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.537837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d102d4-01ce-4e14-b3e3-80386f20c831 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.542590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.543273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.543555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.543829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.544608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.544909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.547071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.562196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 492/977] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:01.563420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.574275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34407d-336e-41a7-b365-a396962cdb3d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.578826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.579591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.579876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.580147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.590112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.591932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.610377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:42:01.611539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 486/978] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:42:01.618012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.627673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a60a1d-88ed-4dc8-b42b-605f1292a486 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.632376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.633050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.633329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.633599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.634324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.634619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.636189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39287a-292d-47bf-a856-bd4d80d2b8b8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.647623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 493/979] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:01.654147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.664589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bd86e-761f-44ab-85e2-74498384d923 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.669302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.670082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.671051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.671335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.672677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc9b-3b4e-4033-b732-b59d80f37254 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.673102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc9b-3b4e-4033-b732-b59d80f37254 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.673269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc9b-3b4e-4033-b732-b59d80f37254 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.675007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 494/980] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:42:01.678896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.680849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.680991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.681165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.681440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.694892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:42:01.696066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 487/981] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:01.698398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:01.699574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:01.702368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.707365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 495/982] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:01.711616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff56940-788d-45d9-99b1-579f5661acfe admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.716105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.716723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.717027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.717835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.718657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.718960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.720782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.731152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.738189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 488/983] 10.222.0.42 () {56 vars in 1154 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:01.740495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca66db-e9f9-4ae3-9820-6946088966a3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.744270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.745100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.745879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.746160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.746432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.753550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ccc3-5452-48ef-90f2-351c8adf3c31 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.756698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:01.758052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.758657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.758933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.759201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.763595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:01.764997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 496/984] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:42:01.767092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.768846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.771514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.783527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 489/985] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:01.783708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c729-cca7-4f98-98b0-c65d394f1e44 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.784497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.786212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.786840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.787113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.787376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.788120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.788420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.790029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.792717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e38d-48b9-4d10-8ab3-e4a6c8e5d0df admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.798494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.798619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 497/986] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:01.799249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.799528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.799867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.804920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.810032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.811844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.813966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ed738-b154-4f0c-a282-b01f767722ff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.818332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.819163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.819438 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.819709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] PATH_INFO: `/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.820881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] RBAC: Authorizing `identity:get_user(user_id=5d5cd4df19ce4be8b320b8c3dc726ebd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.822979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.824662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 498/987] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:01.829278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:42:01.835475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 490/988] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:01.835600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.836352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.839954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c87c6-9de8-4306-b057-588967ecd475 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.845228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.846034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fdd78-a5d4-42d4-9a23-309a18f0d021 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.846136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.846318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.846601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.847779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.849858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.850665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.851276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.856838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 499/989] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:01.856977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.856977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.856977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.856977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.856977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.857730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.871522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 491/990] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:01.871664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b04c-af39-4582-ac85-b6bf4b3eaebe admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.871939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.872697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.872981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.873114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.873395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba/users/5d5cd4df19ce4be8b320b8c3dc726ebd/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.875352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557e8120af564b7e89ab21eedf471cba, user_id=5d5cd4df19ce4be8b320b8c3dc726ebd, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.878293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.882177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee89e6-9b64-4c04-baa9-08b659e9657d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.888317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.889126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.889405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.889683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.891571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 500/991] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:42:01 2021] PUT /identity/v3/projects/557e8120af564b7e89ab21eedf471cba/users/5d5cd4df19ce4be8b320b8c3dc726ebd/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:42:01.896712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.898742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:01.914055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:42:01.915344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 492/992] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:01.923297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:01.986418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f3539-4313-4c46-acbd-682fefea8059 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:01.991113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:01.991779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:01.992062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:01.992336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:01.993181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:01.993493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:01.995355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95365f54-2bb9-4514-8e9c-effcbf422d5b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:02.008121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 501/993] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:42:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:02.015602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:02.025773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e5f35-9b05-4841-818b-776a6f5f42a7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:02.031132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:02.031791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:02.032075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:02.032350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:02.033236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] RBAC: Adding query filter params (role.id=f3d1b653f83b487c986208ea54d23750, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=d0942cb70c474b06a9ea51db2f3298c0) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:02.033548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:02.035391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3439a-6e53-46a0-ac0d-22a0552d6c8b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:02.042181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 493/994] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:02 2021] GET /identity/v3/role_assignments?user.id=d0942cb70c474b06a9ea51db2f3298c0&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=f3d1b653f83b487c986208ea54d23750 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:04.155969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb919c-b46b-45e5-b107-2825fe325398 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.156529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb919c-b46b-45e5-b107-2825fe325398 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.156529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb919c-b46b-45e5-b107-2825fe325398 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.158320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 502/995] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:04.164237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.164632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.164815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.182769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:04.183959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:04.191602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 494/996] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:04.215641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb919c-b46b-45e5-b107-2825fe325398 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.228014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb919c-b46b-45e5-b107-2825fe325398 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.232361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.233765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.234046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.234319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.244128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:04.250985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:04.252122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 503/997] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:04.258792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.268150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81874c-6480-4e6f-9381-6f0cc22854d5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.272817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.273573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.273857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.274132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.274890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:04.275196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:04.276772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:04.285535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 495/998] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:04.291858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.301959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2648f-eab4-45c5-b8b3-0c0976152140 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.306883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.307722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.307998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.308267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] PATH_INFO: `/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.310111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] RBAC: Authorizing `identity:get_user(user_id=5d5cd4df19ce4be8b320b8c3dc726ebd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:04.312248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:04.313907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 504/999] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:04.320059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.330382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c6f9e-0655-4709-819c-ced45ba54423 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.334907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.335534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.335818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.336094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.344210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:04.345978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:04.354621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 496/1000] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:04.363112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.377789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da61496-68c2-43a7-b2f1-ae6c52bf8560 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.384142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.385048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.385326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.385593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.387032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:04.390167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313bcc1-aa13-41ab-89a9-bae7e1e2ee5e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:04.391869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 505/1001] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:04.398686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:04.408339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e590c6-f8b0-443d-9fea-d03b8f4cadc3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:04.412903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:04.413560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:04.413841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:04.414113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:04.414944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=557e8120af564b7e89ab21eedf471cba, user.id=5d5cd4df19ce4be8b320b8c3dc726ebd) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:04.415256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:04.417114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bddeb-2f78-42d9-bd3c-7bed4abaa248 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:04.422954 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 497/1002] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:04 2021] GET /identity/v3/role_assignments?user.id=5d5cd4df19ce4be8b320b8c3dc726ebd&scope.project.id=557e8120af564b7e89ab21eedf471cba&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:06.665572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218e87-8ecf-4765-aa97-e5449cc97ee6 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.666091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218e87-8ecf-4765-aa97-e5449cc97ee6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.666091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218e87-8ecf-4765-aa97-e5449cc97ee6 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.667800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 506/1003] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:06.673685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.674062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.674234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.691563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:06.692731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:06.700375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 498/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:06.726600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218e87-8ecf-4765-aa97-e5449cc97ee6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:06.738658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218e87-8ecf-4765-aa97-e5449cc97ee6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:06.743101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:06.743865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.744144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.744420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.745617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:06.747293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac494-9bb0-4155-ba47-726213141283 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:06.748836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 507/1005] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:42:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:06.755012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:06.763722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3647be-9eff-4c66-87d2-9534d5c37e5e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:06.768759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:06.769446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.769720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.769989 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.770705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:06.772588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b347b7-0d08-4828-ba5a-7dcb1d7c0d89 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:06.791996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 499/1006] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:42:06 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:09.053727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf17d-386a-4ac5-8360-60a295c60ddf None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.054290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf17d-386a-4ac5-8360-60a295c60ddf None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.054290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaf17d-386a-4ac5-8360-60a295c60ddf None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.056037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 508/1007] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:09.062469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.062908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.062996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.080227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:09.081445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:09.089161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 500/1008] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:09.115281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaf17d-386a-4ac5-8360-60a295c60ddf None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.127209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaf17d-386a-4ac5-8360-60a295c60ddf None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.131918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.132741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.133331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.133608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] PATH_INFO: `/v3/roles/374f47211fa14a49969dec56f6247939` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.135084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] RBAC: Authorizing `identity:get_role(role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.136093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:42:09.136093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:42:09.136093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:42:09.137095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.138429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 509/1009] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/roles/374f47211fa14a49969dec56f6247939 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:09.144902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.154145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16362-a1b9-4ec9-9456-25c772ef0e8d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.159375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.160246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.160526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.160802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] PATH_INFO: `/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.175064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ac72111bf8c4ec193a5b7b2b1f3404f)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.177231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.178889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 501/1010] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:09.185494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.195736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b892c-de3a-49ad-ab65-5f06e44ee174 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.201622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.202240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.202518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.202786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.211872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.213632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.224509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 510/1011] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:09.231070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.241036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79797051-cf80-4a5d-90ac-96d1655339d9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.245483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.246309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.246583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.246850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.248009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.250090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c059-23c9-4cdb-8ba7-00f948daf308 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.251710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 502/1012] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:09.258511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.267356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3822-b930-45a7-baf4-d664bc204d57 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.271900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.272520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.272793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.273089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.273914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=557e8120af564b7e89ab21eedf471cba, user.id=2ac72111bf8c4ec193a5b7b2b1f3404f) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:09.274220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.276039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abe81-7abe-49e2-8519-659e7393493b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.281692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 511/1013] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/role_assignments?user.id=2ac72111bf8c4ec193a5b7b2b1f3404f&scope.project.id=557e8120af564b7e89ab21eedf471cba&role.id=374f47211fa14a49969dec56f6247939 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:11.548610 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d878d3-a8da-40af-ab8a-1f4802859bb7 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.549188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d878d3-a8da-40af-ab8a-1f4802859bb7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.549188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d878d3-a8da-40af-ab8a-1f4802859bb7 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.550972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 503/1014] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:11.557181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.557591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.557730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.575641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:11.576753 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:11.584461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:11.610076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d878d3-a8da-40af-ab8a-1f4802859bb7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:11.622098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d878d3-a8da-40af-ab8a-1f4802859bb7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:11.626517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:11.627342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.627622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.627895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] PATH_INFO: `/v3/roles/374f47211fa14a49969dec56f6247939` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.629651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] RBAC: Authorizing `identity:get_role(role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:11.630647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:42:11.630647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:42:11.630647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:42:11.631515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:11.632826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 504/1016] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:11 2021] GET /identity/v3/roles/374f47211fa14a49969dec56f6247939 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:11.639031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:11.647881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549986e-c565-4c3d-85ca-f2b99d0887e9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:11.652430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:11.653308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.653590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.653861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] PATH_INFO: `/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.655609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] RBAC: Authorizing `identity:get_user(user_id=2ac72111bf8c4ec193a5b7b2b1f3404f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:11.657769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:11.659582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 513/1017] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:11 2021] GET /identity/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:11.665823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:11.676547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9093d-6b54-4626-b91a-51fb598e0af0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:11.680983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:11.681806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.682083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.682352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.683501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:11.685541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea93f-373b-40a2-9753-6d4c758962ef admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:11.687157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 505/1018] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:11 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:11.693337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:11.703209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75d21-55f5-4d11-b44b-05a7fcb184dd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:11.707720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:11.708564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.708841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.709147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba/users/2ac72111bf8c4ec193a5b7b2b1f3404f/roles/374f47211fa14a49969dec56f6247939` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.711358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557e8120af564b7e89ab21eedf471cba, user_id=2ac72111bf8c4ec193a5b7b2b1f3404f, role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:11.713989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63718ee-52e3-4dcd-9551-49719e945741 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:11.727655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 514/1019] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:42:11 2021] PUT /identity/v3/projects/557e8120af564b7e89ab21eedf471cba/users/2ac72111bf8c4ec193a5b7b2b1f3404f/roles/374f47211fa14a49969dec56f6247939 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:42:13.926268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6711c4-a4f5-4a1e-a83c-37449cd54ee0 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:13.926824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6711c4-a4f5-4a1e-a83c-37449cd54ee0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:13.926824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6711c4-a4f5-4a1e-a83c-37449cd54ee0 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:13.928567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 506/1020] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:13.934612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:13.935001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:13.935162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:13.953760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:13.954944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:14.009543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 515/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:14.033902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6711c4-a4f5-4a1e-a83c-37449cd54ee0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.046194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6711c4-a4f5-4a1e-a83c-37449cd54ee0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.050638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.051461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.051740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.052012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] PATH_INFO: `/v3/roles/374f47211fa14a49969dec56f6247939` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.053504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] RBAC: Authorizing `identity:get_role(role_id=374f47211fa14a49969dec56f6247939)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.055069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.056377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 507/1022] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/roles/374f47211fa14a49969dec56f6247939 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:14.062967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.071581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375655f-7dda-4f60-837c-e81515baa24c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.076013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.076845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.077149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.077420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] PATH_INFO: `/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.078597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] RBAC: Authorizing `identity:get_user(user_id=2ac72111bf8c4ec193a5b7b2b1f3404f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.080711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.082581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 516/1023] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:14.088615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.097979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7425-c600-4597-b9e9-267279f28718 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.102533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.103145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.103428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.103704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.111808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.113557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.122125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 508/1024] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:14.129070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.138419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8c96f-87d9-43d9-a4b9-667172b2898e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.142957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.143773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.144053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.144328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.145528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.147543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecf1e8-9b12-4d11-a1f2-aa8c5059c38c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.149195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 517/1025] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:14.155485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.163999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2a8f1-98a7-4f59-8072-11f9aa66520e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.168679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.169347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.169624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.169896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.171222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] RBAC: Adding query filter params (role.id=374f47211fa14a49969dec56f6247939, scope.project.id=557e8120af564b7e89ab21eedf471cba, user.id=2ac72111bf8c4ec193a5b7b2b1f3404f) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:14.171530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.173382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b894d-4bf7-46dd-b846-fdb5a0f8e415 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.179377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 509/1026] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/role_assignments?user.id=2ac72111bf8c4ec193a5b7b2b1f3404f&scope.project.id=557e8120af564b7e89ab21eedf471cba&role.id=374f47211fa14a49969dec56f6247939 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:16.423967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c444-37a7-43bf-a72d-1e980aba17bd None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.424592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c444-37a7-43bf-a72d-1e980aba17bd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.424592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41c444-37a7-43bf-a72d-1e980aba17bd None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.426310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 518/1027] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:16.432304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.432744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.432840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.450891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:16.452100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:16.459666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 510/1028] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:16.484533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c444-37a7-43bf-a72d-1e980aba17bd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:16.496373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41c444-37a7-43bf-a72d-1e980aba17bd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:16.501346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:16.502102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.502384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.502658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.504079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:16.506350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154a5ca-58e8-49d7-b948-539d32bfd7f7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:16.507911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 519/1029] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:42:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:16.514153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:16.522929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9c954-81d5-4fdd-9c9d-e6ec8c0041f2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:16.527556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:16.528202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.528481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.528754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.529542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:16.531437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b636e1b-5163-4d29-933d-845c97d5a9d5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:16.555987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 511/1030] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:42:16 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:18.830053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb3c-a480-4d22-926b-07da7ac59217 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:18.830609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb3c-a480-4d22-926b-07da7ac59217 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:18.830609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cb3c-a480-4d22-926b-07da7ac59217 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:18.832362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 520/1031] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:18.838170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:18.838585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:18.838713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:18.858069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:18.859236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:18.915823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 512/1032] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:18.941808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771cb3c-a480-4d22-926b-07da7ac59217 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:18.954662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771cb3c-a480-4d22-926b-07da7ac59217 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:18.959044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:18.959814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:18.960092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:18.960363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:18.961561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:18.963237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c1288-f6f6-418f-9efe-8ac2bf99557c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:18.964797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 521/1033] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:42:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:18.970968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:18.979607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2ae5-f221-494d-aac2-62e91639962e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:18.984060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:18.984698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:18.985003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:18.985275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:18.985999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:18.987886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ce8-94b9-4e59-8f5d-cde4fce97ec3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:19.007633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 513/1034] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:42:18 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:21.274982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1069-b8f7-4861-a738-d9126e75884b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.275538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1069-b8f7-4861-a738-d9126e75884b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.275538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1069-b8f7-4861-a738-d9126e75884b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.277318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 522/1035] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:21.283177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.283589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.283727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.300871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:21.302083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:21.309671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 514/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:21.334835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1069-b8f7-4861-a738-d9126e75884b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.347185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1069-b8f7-4861-a738-d9126e75884b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.351432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.352190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.352466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.352736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.363546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:21.370395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:21.371521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 523/1037] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:21.378205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.386928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30450a-fffe-41be-9f3a-ae624b95a5eb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.391470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.392115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.392398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.392674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.393468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:21.393778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.395362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.403414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 515/1038] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:21.410057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.420699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f16c51-15c0-472b-8453-dd384eb7fb70 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.426732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.427574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.427848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.428123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] PATH_INFO: `/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.440892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] RBAC: Authorizing `identity:get_user(user_id=f6817b1dadd544c5ab6ff9a99f1eb494)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.443035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.444677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 524/1039] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:21.451189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.460796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bda457-0a63-433d-b203-783911de6ead admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.465344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.465971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.466252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.466523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.474624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.476345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.485544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:21.491887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.501185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ff64-e295-40a8-9e63-8d67dc94b97e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.505925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.506751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.507027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.507297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] PATH_INFO: `/v3/projects/20e5d8309d0d4c479df70ac4253c7217` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.508454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] RBAC: Authorizing `identity:get_project(project_id=20e5d8309d0d4c479df70ac4253c7217)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.510505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71137c5-3c31-40de-b067-2672bb15ae14 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.512120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 525/1041] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/projects/20e5d8309d0d4c479df70ac4253c7217 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:21.519091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.527598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf472-6c54-4bb5-9968-638a4201ac71 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.532629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.533275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.533557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.533831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.534651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=20e5d8309d0d4c479df70ac4253c7217, user.id=f6817b1dadd544c5ab6ff9a99f1eb494) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:21.534959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.536762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51dd72-82c0-4df1-a4b9-e656671a20b6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.542061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 517/1042] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/role_assignments?user.id=f6817b1dadd544c5ab6ff9a99f1eb494&scope.project.id=20e5d8309d0d4c479df70ac4253c7217&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:23.770653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df49-bf7a-4abc-b62f-9f2b08a16968 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.771207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df49-bf7a-4abc-b62f-9f2b08a16968 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.771207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df49-bf7a-4abc-b62f-9f2b08a16968 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.772987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 526/1043] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:23.778811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.779783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.779927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.797095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:23.798288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:23.805837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 518/1044] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:23.830028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df49-bf7a-4abc-b62f-9f2b08a16968 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:23.842466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df49-bf7a-4abc-b62f-9f2b08a16968 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:23.846767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:23.847526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.847803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.848104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.857970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:23.864784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:23.865942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 527/1045] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:23.872402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:23.881363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec8abb-5061-4106-a679-4a60e2021a61 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:23.885784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:23.886425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.886701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.886972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.887721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:23.888022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:23.890130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:23.898161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 519/1046] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:23.904811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:23.914759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7e93-0612-4fe5-8491-12f922e1b982 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:23.919269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:23.920116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.920398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.920671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] PATH_INFO: `/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.921912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] RBAC: Authorizing `identity:get_user(user_id=f6817b1dadd544c5ab6ff9a99f1eb494)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:23.924010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:23.925640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 528/1047] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:23 2021] GET /identity/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:23.931749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:23.941905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40733dba-6421-42e8-bc6f-a76b3fe8ba46 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:23.946405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:23.947244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.947525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.947800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] PATH_INFO: `/v3/projects/20e5d8309d0d4c479df70ac4253c7217` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.949013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] RBAC: Authorizing `identity:get_project(project_id=20e5d8309d0d4c479df70ac4253c7217)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:23.951540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa2fb-9b76-48ab-ba93-370d1cd9be06 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:23.953226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 520/1048] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:23 2021] GET /identity/v3/projects/20e5d8309d0d4c479df70ac4253c7217 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:42:23.959710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:23.970132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddf328-610c-4e03-9533-79f0e62f4587 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:23.974601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:23.975453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:23.975728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:23.976029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] PATH_INFO: `/v3/projects/20e5d8309d0d4c479df70ac4253c7217/users/f6817b1dadd544c5ab6ff9a99f1eb494/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:23.977957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e5d8309d0d4c479df70ac4253c7217, user_id=f6817b1dadd544c5ab6ff9a99f1eb494, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:23.980560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c93ce3-c645-46ad-85b1-839b2246b2de admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:23.993591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 529/1049] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:42:23 2021] PUT /identity/v3/projects/20e5d8309d0d4c479df70ac4253c7217/users/f6817b1dadd544c5ab6ff9a99f1eb494/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:42:26.217689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2de6-125b-4749-b9f7-e7cfe79882df None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.218272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2de6-125b-4749-b9f7-e7cfe79882df None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.218272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2de6-125b-4749-b9f7-e7cfe79882df None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.220005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 521/1050] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:26.226021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.226427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.226577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.244290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:26.245509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:26.302666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 530/1051] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:26.327813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed2de6-125b-4749-b9f7-e7cfe79882df None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.339709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed2de6-125b-4749-b9f7-e7cfe79882df None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.344528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.345336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.345620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.345900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.355702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:26.363144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:26.364284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 522/1052] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:26.370687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.379706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9a43-84fe-4fa0-b84f-72203d001904 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.384211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.384853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.385168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.385444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.386201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:26.386505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:26.388102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:26.396062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 531/1053] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:26.402425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.413380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc711441-42ae-464d-abe4-0c03d4a3cc63 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.417939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.418781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.419058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.419336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] PATH_INFO: `/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.421172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=f6817b1dadd544c5ab6ff9a99f1eb494)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:26.423291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:26.424933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 523/1054] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:26.431490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.441192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe31f6d-c1c6-4150-b8d7-c5ed3afe1835 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.445733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.446363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.446649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.446927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.454469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:26.456216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:26.464807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 532/1055] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:26.471627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.480934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2ce8-8c4f-478d-9c88-b21fa36490c4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.486075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.486893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.487171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.487440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] PATH_INFO: `/v3/projects/20e5d8309d0d4c479df70ac4253c7217` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.488598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=20e5d8309d0d4c479df70ac4253c7217)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:26.490653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280c308-23c1-4345-a7c7-d5c78af689b4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:26.492318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 524/1056] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/projects/20e5d8309d0d4c479df70ac4253c7217 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:26.498644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:26.507470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6c9bc-ec70-4d49-a2d4-3b857a63060a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:26.512221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:26.512848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.513158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.513435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.514273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=20e5d8309d0d4c479df70ac4253c7217, user.id=f6817b1dadd544c5ab6ff9a99f1eb494) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:26.514584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:26.516404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c371c-f6a6-4450-b511-bb0f4e0c47b0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:26.522196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 533/1057] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:26 2021] GET /identity/v3/role_assignments?user.id=f6817b1dadd544c5ab6ff9a99f1eb494&scope.project.id=20e5d8309d0d4c479df70ac4253c7217&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:28.802016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67053d33-7794-4b68-a47f-beb682f197d2 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:28.802566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67053d33-7794-4b68-a47f-beb682f197d2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:28.802566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67053d33-7794-4b68-a47f-beb682f197d2 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:28.804304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 525/1058] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:28.810991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:28.811411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:28.811535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:28.829228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:28.830409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:28.837964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 534/1059] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:28.860920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67053d33-7794-4b68-a47f-beb682f197d2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:28.873165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67053d33-7794-4b68-a47f-beb682f197d2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:28.877454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:28.878323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:28.878596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:28.878862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:28.886255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:28.887963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:28.896979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 526/1060] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:28.903381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:28.912076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c203ce5-7429-4607-886d-4c3a88590fb8 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:28.916516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:28.917325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:28.917606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:28.917878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:28.924587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:28.926458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:28.941878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-31f24d9a-4e48-4568-95b1-75d24bb1938e admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 12 16:42:28.943102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 535/1061] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:42:28 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:28.950071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:28.959378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce34c8-bcc4-4b1b-a727-4c14f9c53915 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:28.963851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:28.964481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:28.964758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:28.965061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:28.965780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:28.966080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:28.967634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c57a9-9084-4cce-a6e3-ffec53ad00d5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:28.974601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 527/1062] 10.222.0.42 () {56 vars in 1136 bytes} [Tue Oct 12 16:42:28 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:31.216905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858c000-1879-4efc-af2e-f2b7222ac302 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.217460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858c000-1879-4efc-af2e-f2b7222ac302 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.217460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858c000-1879-4efc-af2e-f2b7222ac302 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.219246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 536/1063] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:31.225318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ea9e7-8b89-4721-8217-1bdd9b0a5e6a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.225757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ea9e7-8b89-4721-8217-1bdd9b0a5e6a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.225873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ea9e7-8b89-4721-8217-1bdd9b0a5e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.243705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-589ea9e7-8b89-4721-8217-1bdd9b0a5e6a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:31.244879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-589ea9e7-8b89-4721-8217-1bdd9b0a5e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:31.252529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 528/1064] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:31.277010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858c000-1879-4efc-af2e-f2b7222ac302 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:31.289529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858c000-1879-4efc-af2e-f2b7222ac302 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:31.293874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:31.294503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.294779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.295049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.295786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:31.296774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:42:31.296774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:42:31.296774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:42:31.297686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e938f1-5df7-4c15-ba0c-0c3bf72988df admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:31.311969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 537/1065] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 12 16:42:31 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:33.585563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944bd1-af01-441e-a40e-98e652042511 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:33.586076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944bd1-af01-441e-a40e-98e652042511 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:33.586076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944bd1-af01-441e-a40e-98e652042511 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:33.587809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 529/1066] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:33.593946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:33.594361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:33.594501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:33.612487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:33.613716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:33.668009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 538/1067] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:33.693298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944bd1-af01-441e-a40e-98e652042511 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:33.705243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944bd1-af01-441e-a40e-98e652042511 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:33.709497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:33.710323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:33.710604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:33.710869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] PATH_INFO: `/v3/domains/3388443d7fa945e6ae73b07587f6f5bc` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:33.721142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3388443d7fa945e6ae73b07587f6f5bc)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:33.723085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961d04-32ec-40c5-b1c7-4758cfcca2cb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:33.724796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 530/1068] 10.222.0.42 () {56 vars in 1204 bytes} [Tue Oct 12 16:42:33 2021] GET /identity/v3/domains/3388443d7fa945e6ae73b07587f6f5bc => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:33.730807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:33.740052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c593-94c4-4ae2-ba55-10980eac3105 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:33.744693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:33.745382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:33.745666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:33.745941 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:33.746663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:33.749212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b24baf-5122-49a3-b705-2da1116cf295 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:33.775460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 539/1069] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:42:33 2021] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:36.047480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21469-7975-4284-bb56-14e9981b5c12 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.048040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21469-7975-4284-bb56-14e9981b5c12 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.048040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21469-7975-4284-bb56-14e9981b5c12 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.049813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 531/1070] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:36.055864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.056258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.056411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.073995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:36.075318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:36.133037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 540/1071] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:36.160108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21469-7975-4284-bb56-14e9981b5c12 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:36.172532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21469-7975-4284-bb56-14e9981b5c12 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:36.176903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d482-3493-440d-b478-95de5add021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:36.177842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d482-3493-440d-b478-95de5add021a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.178125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d482-3493-440d-b478-95de5add021a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.178404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d482-3493-440d-b478-95de5add021a admin admin] PATH_INFO: `/v3/domains/3388443d7fa945e6ae73b07587f6f5bc` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.179875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731d482-3493-440d-b478-95de5add021a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3388443d7fa945e6ae73b07587f6f5bc)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:36.181870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731d482-3493-440d-b478-95de5add021a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:36.183452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 532/1072] 10.222.0.42 () {56 vars in 1204 bytes} [Tue Oct 12 16:42:36 2021] GET /identity/v3/domains/3388443d7fa945e6ae73b07587f6f5bc => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:36.190301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:36.199229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574b118-976d-4035-a484-909b9cd3a6b3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:36.204476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:36.205152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.205432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.205703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.206430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:36.208318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6aaba-e369-46f7-9144-3c7497b1bce5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:36.227486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 541/1073] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:42:36 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:42:38.536404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129bf54-3947-4e8b-aa39-99265bdf21f1 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.536960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129bf54-3947-4e8b-aa39-99265bdf21f1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.536960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129bf54-3947-4e8b-aa39-99265bdf21f1 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.538725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 533/1074] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:38.545326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.545697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.545881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.563089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:38.564207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:38.571837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 542/1075] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:38.596387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129bf54-3947-4e8b-aa39-99265bdf21f1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.609222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129bf54-3947-4e8b-aa39-99265bdf21f1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.613585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.614342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.614615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.614882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.626195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:38.633229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:38.634350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 534/1076] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:38.641508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.654960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea67da5-ce62-4bc7-a5ac-e70b5eeb8de5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.661167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.661815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.662097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.662372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.663130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:38.663436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:38.665050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:38.673168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 543/1077] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:38.679460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.689257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6aa2a-2a27-4706-9531-d3bb72b004a6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.693773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.694605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.694880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.695149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] PATH_INFO: `/v3/users/30442ae5eaf142eb87cd0beca5fcea8a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.708745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] RBAC: Authorizing `identity:get_user(user_id=30442ae5eaf142eb87cd0beca5fcea8a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:38.710909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:38.712520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 535/1078] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/users/30442ae5eaf142eb87cd0beca5fcea8a => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:38.718891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.728655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841bb7f-46d7-4046-8f6c-9ac8aca51d6c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.733679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.734310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.734593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.734871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.742601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:38.744342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:38.753812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 544/1079] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:38.760108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.769492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de7619-4e4b-4295-be6c-2cf841cd2420 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.774091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.774912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.775192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.775461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] PATH_INFO: `/v3/projects/b61275effdf24482bcc1bd65402937f8` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.776635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] RBAC: Authorizing `identity:get_project(project_id=b61275effdf24482bcc1bd65402937f8)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:38.779062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99308-351a-4460-84a7-ed8d4e37d862 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:38.780699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 536/1080] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/projects/b61275effdf24482bcc1bd65402937f8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:38.787067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:38.796081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7bbec-209c-4c16-ad5b-7affff7fff86 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:38.800604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:38.801313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:38.801595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:38.801868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:38.802695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=b61275effdf24482bcc1bd65402937f8, user.id=30442ae5eaf142eb87cd0beca5fcea8a) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:38.803004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:38.804801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4fc36-a5e1-40fb-992c-8f4a70c91ba6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:38.810559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 545/1081] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:38 2021] GET /identity/v3/role_assignments?user.id=30442ae5eaf142eb87cd0beca5fcea8a&scope.project.id=b61275effdf24482bcc1bd65402937f8&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:40.992090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3c98-48a2-431b-9779-4c44bd84c3fc None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:40.992621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3c98-48a2-431b-9779-4c44bd84c3fc None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:40.992621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3c98-48a2-431b-9779-4c44bd84c3fc None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:40.994438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 537/1082] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:41.000241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.000613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.000789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.018566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:41.019729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:41.027226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 546/1083] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:41.050579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3c98-48a2-431b-9779-4c44bd84c3fc None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.062462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3c98-48a2-431b-9779-4c44bd84c3fc None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.066826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.067587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.067869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.068142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.078501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:41.085635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:41.086881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 538/1084] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:41.094082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.102981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de302920-2185-4f1f-93a0-f32f8595e618 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.108027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.108667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.108964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.109278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.110033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:41.110336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:41.111909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:41.119848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 547/1085] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:41.126550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.136158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6e09-0ad4-4b10-bda4-2647c024b367 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.140701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.141581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.141865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.142140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] PATH_INFO: `/v3/users/30442ae5eaf142eb87cd0beca5fcea8a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.143322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] RBAC: Authorizing `identity:get_user(user_id=30442ae5eaf142eb87cd0beca5fcea8a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:41.145477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:41.147035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 539/1086] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:41 2021] GET /identity/v3/users/30442ae5eaf142eb87cd0beca5fcea8a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:41.152977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.162369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a08e-4878-4914-98da-8ee8fb4304ab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.167514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.168334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.168618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.168893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] PATH_INFO: `/v3/projects/b61275effdf24482bcc1bd65402937f8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.170636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b61275effdf24482bcc1bd65402937f8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:41.172664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2adfbe-7ba9-4a97-ab07-daa27b7940e8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:41.174313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 548/1087] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:41 2021] GET /identity/v3/projects/b61275effdf24482bcc1bd65402937f8 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:41.180318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.190645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8dff-71ae-4a68-8e95-1ca51c086271 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.195134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.195960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.196241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.196506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] PATH_INFO: `/v3/projects/b61275effdf24482bcc1bd65402937f8/users/30442ae5eaf142eb87cd0beca5fcea8a/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.198461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61275effdf24482bcc1bd65402937f8, user_id=30442ae5eaf142eb87cd0beca5fcea8a, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:41.201080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ecf4c-64ba-4d25-9775-f67c29736467 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:41.213613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 540/1088] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:42:41 2021] PUT /identity/v3/projects/b61275effdf24482bcc1bd65402937f8/users/30442ae5eaf142eb87cd0beca5fcea8a/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:42:43.444378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1a9b-78f8-4dcc-9063-6478cfe1f046 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.444978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1a9b-78f8-4dcc-9063-6478cfe1f046 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.444978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1a9b-78f8-4dcc-9063-6478cfe1f046 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.446717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 549/1089] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:42:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:43.453047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.453436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.453586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.470273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:43.471450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:43.525139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 541/1090] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:43.549843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e1a9b-78f8-4dcc-9063-6478cfe1f046 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.562446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e1a9b-78f8-4dcc-9063-6478cfe1f046 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.566836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.567602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.567885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.568160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.578030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:42:43.584904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:42:43.586050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 550/1091] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:42:43.593002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.601630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78be7f-15fa-4536-9448-a9e649adf035 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.606062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.607308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.607584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.607851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.608596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:43.608895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.610493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.618541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 542/1092] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:43.624529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.634706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc34b11-92f0-4dbc-9dc7-f7f88c677b82 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.639250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.640080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.640364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.640640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] PATH_INFO: `/v3/users/30442ae5eaf142eb87cd0beca5fcea8a` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.641865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] RBAC: Authorizing `identity:get_user(user_id=30442ae5eaf142eb87cd0beca5fcea8a)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.643956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.645663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 551/1093] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/users/30442ae5eaf142eb87cd0beca5fcea8a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:43.651574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.661176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562742-a57f-4976-a967-e42a089e32c1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.665615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.666212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.666491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.666760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.674680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.676351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.684779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 543/1094] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:43.690789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.700049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6e242-2246-4d27-b45b-97f4fa018db6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.704621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.705465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.705745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.706016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] PATH_INFO: `/v3/projects/b61275effdf24482bcc1bd65402937f8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.707175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] RBAC: Authorizing `identity:get_project(project_id=b61275effdf24482bcc1bd65402937f8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.709205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8f52-9047-4112-9efd-83096268f8cd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.710810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 552/1095] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/projects/b61275effdf24482bcc1bd65402937f8 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:43.717611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.725975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0df5-f0a8-4725-bd07-76f3e40b7492 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.730491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.731100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.731378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.732274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.733134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=b61275effdf24482bcc1bd65402937f8, user.id=30442ae5eaf142eb87cd0beca5fcea8a) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:42:43.733445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.735225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188fb03-2274-4e15-8c2f-b131c55ab158 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.740733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 544/1096] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/role_assignments?user.id=30442ae5eaf142eb87cd0beca5fcea8a&scope.project.id=b61275effdf24482bcc1bd65402937f8&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:39.453943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c7ba-2a69-416e-bd5a-993d58f35631 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.454533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c7ba-2a69-416e-bd5a-993d58f35631 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.454533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c7ba-2a69-416e-bd5a-993d58f35631 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.456703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 553/1097] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:39.463766 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795100-184b-4e36-b074-29510234ab6a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.465046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795100-184b-4e36-b074-29510234ab6a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.465046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a795100-184b-4e36-b074-29510234ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.487590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8a795100-184b-4e36-b074-29510234ab6a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:39.488762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8a795100-184b-4e36-b074-29510234ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:39.502102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 545/1098] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:39.525781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c7ba-2a69-416e-bd5a-993d58f35631 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:39.544763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c7ba-2a69-416e-bd5a-993d58f35631 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:39.550216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:39.550982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.551271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.551525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.563755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:39.565633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:39.586734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:39.587975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 554/1099] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:39.597987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a795100-184b-4e36-b074-29510234ab6a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:39.613005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a795100-184b-4e36-b074-29510234ab6a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:39.619227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:39.620284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.621586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.622121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.623233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:39.623769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:39.625970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3c4f0-2543-4e16-8d87-73a0b3a15c6a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:39.641091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 546/1100] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:39.647830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:39.660650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb103e-6433-44c5-91d6-2e114253049b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:39.666903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:39.667671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:39.668148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:39.668463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:39.669312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:39.671426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b48a7-364a-4136-86d8-4c324ed803cb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:39.701295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 555/1101] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Oct 12 16:43:39 2021] POST /identity/v3/users => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:43:42.198397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b05a-9907-42ef-9f96-670be2715a46 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.199037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b05a-9907-42ef-9f96-670be2715a46 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.199037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b05a-9907-42ef-9f96-670be2715a46 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.201026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 547/1102] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:42.208009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.208477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.208611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.228412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:42.230589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:42.239616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 556/1103] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:42.263539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616b05a-9907-42ef-9f96-670be2715a46 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.278414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616b05a-9907-42ef-9f96-670be2715a46 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.284223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.285070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.285354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.285642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.298624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:42.312022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:43:42.313365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 548/1104] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:42.320276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.330700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108fb45-7906-4c0c-b95f-a4a16f2e5791 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.336060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.336883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.337327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.337696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.338666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.339582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.341367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.350871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 557/1105] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:42.357534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.368409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9a22-e587-403f-b2cb-f322ac8cdd55 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.377183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.378561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.378862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.378999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.390646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.394638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.410906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:42.412283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 549/1106] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:42.419232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.432472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150803-ec14-453d-99ab-41a35493f45d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.437541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.438214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.438887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.438887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.439460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.439793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.441384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.454698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 558/1107] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:42.460891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.471582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c7b78-ed15-413b-97fd-25135daa525e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.477024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.477833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.479109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.479109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.486570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.488570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.503108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:42.504297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 550/1108] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:42.511586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.521670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04105c4-cceb-4bd7-8212-6192cc7e2377 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.528117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.528935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.529275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.529603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.530538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.531149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.532976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.554687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 559/1109] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:42.561266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.575113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a2cc-02db-43ed-b59c-3573f8c7b5b6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.579980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.580633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.580917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.581220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.592066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.593997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.608867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 551/1110] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:42.616220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.628112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a48bb-573e-4eb0-8569-b9e7fe952989 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.633458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.634238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.634530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.634819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.645818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.647742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.665515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:42.666671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 560/1111] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:42.674161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.683093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4de09b-3d5c-48d3-aeb9-e3385d42b2d6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.688444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.689169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.689629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.689917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.690632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.690942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.692487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.705430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 552/1112] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:42.716401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.729665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9b2f-d5b8-477d-b75e-dafcdf066fd0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.736154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.736961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.737240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.737512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.745503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.747674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.762108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:42.763306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 561/1113] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:42.771245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.785766 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76534ad-e26c-4c00-8228-896d49622804 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.792113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.793397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.793735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.794014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.794863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.795173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.797041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547442e-8cd3-476a-9d06-f4df2f5cfec6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.818335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 553/1114] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:42.820854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:42.831830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd53a-3850-4ba7-83bb-b105755b550d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:42.837582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:42.838226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:42.838507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:42.838813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:42.840140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=9df7a67d7326462582f66270c29c0fd9) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:42.840444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:42.842456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917eada-37da-49dd-ad2a-70ae1c84848d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:42.848679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 562/1115] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:43:42 2021] GET /identity/v3/role_assignments?user.id=9df7a67d7326462582f66270c29c0fd9&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:45.120917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ab18-570b-4916-b444-bb44c662547e None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.121507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ab18-570b-4916-b444-bb44c662547e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.121507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ab18-570b-4916-b444-bb44c662547e None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.123493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 554/1116] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:45.129890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.130337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.130432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.149043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:45.150229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:45.158632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 563/1117] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:45.182663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ab18-570b-4916-b444-bb44c662547e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.194880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ab18-570b-4916-b444-bb44c662547e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.199409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.200186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.200465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.200733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.211264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:45.218756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:43:45.220098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 555/1118] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:45.226806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.236781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f02e1-8be1-400f-a3e7-36f81ad69b7d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.241443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.242099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.242413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.242705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.243497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:45.243803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.245522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.254186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 564/1119] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:45.262396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.273377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f1e4-68e6-4c70-82bf-014822a92ace admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.279200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.280076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.280358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.280628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.292135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.294644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.313908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:45.315603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 556/1120] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:45.322183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.334710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a104d6-d4a5-4dee-9e9b-28e3afc0a720 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.342141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.342935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.343324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.343705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.344574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:45.344970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.346624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.360825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 565/1121] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:45.368024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.380503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c71c-0fdf-4a06-af60-417de114602c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.385544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.386373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.386657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.386945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.395571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.397860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.414030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:45.416322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 557/1122] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:45.423277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.434248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac8aa-d45b-4bbc-8671-fec7e1a205f6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.439987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.440686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.440993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.441265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.442126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:45.442422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.444259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.465560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 566/1123] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:45.471907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.482976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153369b9-7d31-49c9-94dc-6cec83de941f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.488056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.488840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.489182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.489425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.501964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.505441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.540049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:45.547627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 558/1124] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:45.548692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.559072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6ebd-8449-4630-b41c-a62f7cffea27 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.564860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.565631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.565927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.566237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.567117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:45.567476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.569429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.589007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 567/1125] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:45.596990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.603833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee4f05-e4d7-4ec6-989e-1da6f7265907 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.609755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.610717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.611101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.611497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.620307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.622524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.637864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:45.639207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 559/1126] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:45.645870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.658049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3b65-78e4-4eea-94f6-9d8be5ad44be admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.663245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.663915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.664197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.664467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.665325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:45.665681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.667584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289a3bc-7b6f-4cd5-84e7-7e3a102cf77d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.681169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 568/1127] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:45.688207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:45.700477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e4f2-06d3-4c4e-8c35-32865b9d4348 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:45.705411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:45.706324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:45.706592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:45.706862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/9df7a67d7326462582f66270c29c0fd9/roles/4e23bf8d33dc447299dd6c1782182897` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:45.723799 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=9df7a67d7326462582f66270c29c0fd9, role_id=4e23bf8d33dc447299dd6c1782182897)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:45.726505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4be97d-0d6a-46bb-82a6-3f178344685e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:45.746831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 560/1128] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:43:45 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/9df7a67d7326462582f66270c29c0fd9/roles/4e23bf8d33dc447299dd6c1782182897 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:43:48.110764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f1ee-2f1b-4e94-bfb5-f122747ecab7 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.111403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f1ee-2f1b-4e94-bfb5-f122747ecab7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.111403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f1ee-2f1b-4e94-bfb5-f122747ecab7 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.113110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 569/1129] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:48.120053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.121189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.121459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.145505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:48.147328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:48.209496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 561/1130] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:48.234686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f1ee-2f1b-4e94-bfb5-f122747ecab7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.249449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f1ee-2f1b-4e94-bfb5-f122747ecab7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.255187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.256065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.256379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.256756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.271372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:48.278912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:43:48.280259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 570/1131] 10.222.0.42 () {56 vars in 1123 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:48.287186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.296607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770c59b-decb-4a77-8cdf-fb8d0edad730 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.301843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.302526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.302859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.303178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.303932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.304288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.306034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.315711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 562/1132] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:48.322973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.336197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e8c06-b05a-48d8-ab84-21f0178805ad admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.341592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.342419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.342775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.343083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.355190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.357072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.375662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:48.376796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 571/1133] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:48.383965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.395162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34db6a-6573-45a6-9c68-c7b7e0937af6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.400204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.400881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.401256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.401564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.402432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.402787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.404485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.417503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 563/1134] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:48.424598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.438922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daaf09-5d99-4219-91e7-3b5ddf051e35 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.444417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.445270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.445552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.445821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.454752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.456964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.471542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:48.472746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 572/1135] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:48.480672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.490544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791d49e-83ad-4a1d-a0e0-94960c1f6575 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.496361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.497136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.497477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.497849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.498738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.499044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.500863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.518624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 564/1136] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:48.525592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.536073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748156a0-4c9a-40cc-aa36-3bfd2ef00b78 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.540774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.541442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.541817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.542491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.550488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.552262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.561870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 573/1137] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:48.569060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.579314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df8a7-adcc-4aa3-916e-79d6e7e8f3ab admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.583988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.584776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.585090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.585369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.596060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.597928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.616197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:48.617765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 565/1138] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:48.624358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.634400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7c302-5f21-42a3-be8d-49ace58692d3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.640323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.641189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.641578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.642175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.642938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.643415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.645293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.658903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 574/1139] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:48.666263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.677877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d82-28f1-46ad-a777-2cbabe8f4e0a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.683832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.684738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.685069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.685422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.693208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.695634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.710473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:48.711657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 566/1140] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:48.718299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.728836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d085db-aafc-4d3f-8f8d-1775ed3aa18b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.734232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.734891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.735146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.735412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.736270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.736612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.738542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbc96d-3022-49cb-a50e-c2be5c88c176 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.751302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 575/1141] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:48.758307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:48.769976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4b355-08b9-4a65-a88b-a41cef92129d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:48.774557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:48.775192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:48.775469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:48.775739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:48.777227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] RBAC: Adding query filter params (role.id=4e23bf8d33dc447299dd6c1782182897, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=9df7a67d7326462582f66270c29c0fd9) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:48.777537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:48.779556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5c0c-b5ed-4540-b8cd-43ecf6d07e97 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:48.786930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 567/1142] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:43:48 2021] GET /identity/v3/role_assignments?user.id=9df7a67d7326462582f66270c29c0fd9&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4e23bf8d33dc447299dd6c1782182897 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:51.260559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b0f2-7ffd-4941-93bb-41b3071d5cad None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.261697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b0f2-7ffd-4941-93bb-41b3071d5cad None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.261697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b0f2-7ffd-4941-93bb-41b3071d5cad None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.264977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 576/1143] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:51.269752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.270268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.270436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.289457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:51.290661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:51.299142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 568/1144] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:51.324431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b0f2-7ffd-4941-93bb-41b3071d5cad None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.338181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5b0f2-7ffd-4941-93bb-41b3071d5cad None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.343731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.344600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.344892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.345202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.357318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:51.365091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:43:51.366289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 577/1145] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:51.374014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.383367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5dcd-79b6-4d4c-8597-1b2423af5e97 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.388605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.389287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.389563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.389833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.390617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.390909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.392480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.402008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 569/1146] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:51.408517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.420739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e7da-57c9-49a2-aea8-12bef83d7b82 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.425711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.426490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.426767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.427038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.438312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.440425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.461094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:51.462430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 578/1147] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:51.469571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.480057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e10c98-7838-40f4-aafc-1f2b99941ec5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.484576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.485257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.485535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.485808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.486533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.486835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.488422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.500541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 570/1148] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:51.507629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.518025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae5e-b524-4cb9-9ac4-31433f48b3ac admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.522552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.523407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.523683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.523945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.532536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.534616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.548565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:51.549932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 579/1149] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:51.556549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.567917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8d359-6c0a-4dd2-a245-4fd2330025ec admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.572883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.574068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.574344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.574618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.575447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.575754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.577651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.595290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 571/1150] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:51.601757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.613627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729820-df7d-4f48-984b-8e1bf0d32615 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.619875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.620734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.621043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.621317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.632161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.634509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.646451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 580/1151] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:51.654723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.665422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da10f-ef22-4419-8449-d6ff5cd0cd2e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.670443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.671267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.671591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.671865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.682691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.684554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.702184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:51.703367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 572/1152] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:51.709846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.719318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1da10-5083-4f29-ac26-717ec78117e6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.724134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.724793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.725106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.725374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.726138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.726437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.728051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.740327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 581/1153] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:51.746782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.757164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead5674-e025-4476-ac20-a910db2f192f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.762399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.763171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.763452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.763724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.771015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.773032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.787367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:51.788655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 573/1154] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:51.795557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.805987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b0eb-9ffc-48bf-88ac-90ed473b0d31 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.811097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.811742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.812025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.812303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.813182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.813495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.815531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297d3e-d263-490c-a42c-dd2cbab6363a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.829641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 582/1155] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:51.836464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:51.847334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6e529-7e7d-447f-8504-1adb99d06853 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:51.851884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:51.852518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:51.852790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:51.853099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:51.853927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=9df7a67d7326462582f66270c29c0fd9) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:51.854265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:51.856113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a199b37-2528-4fc2-a408-f906ea40edad admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:51.862005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 574/1156] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:43:51 2021] GET /identity/v3/role_assignments?user.id=9df7a67d7326462582f66270c29c0fd9&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:54.433811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e6ff-0dd8-4d4f-9e8c-c6267094609c None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.434417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e6ff-0dd8-4d4f-9e8c-c6267094609c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.434417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e6ff-0dd8-4d4f-9e8c-c6267094609c None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.436114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 583/1157] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:43:54.442682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.443175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.443558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.465801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:54.467017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:54.478011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 575/1158] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:43:54.507215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e6ff-0dd8-4d4f-9e8c-c6267094609c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.523861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e6ff-0dd8-4d4f-9e8c-c6267094609c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.529024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.529811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.530108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.530407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.542386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:54.550028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:43:54.551344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 584/1159] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:54.559491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.569159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7ab43-e94a-47d9-8d6e-e5af8b8c9724 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.574836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.575517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.575841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.576140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.576918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:54.577269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.579006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.588508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 576/1160] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:54.596735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.610473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974df5a-9e5c-4231-acd2-67c2b4f4aad4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.617123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.618406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.618733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.619121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.636826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.638711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.658575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:54.660236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 585/1161] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:54.667123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.680970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27964a-3927-4248-ab4b-c65158e52b3a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.685995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.686650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.686930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.687200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.687928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:54.688258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.689883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.703956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 577/1162] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:54.710404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.723855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e90467-bb40-4c08-a37e-27fee0a5fb08 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.728702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.729747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.730017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.730291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.740506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.742942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.757682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:54.758862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 586/1163] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:54.766679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.778337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a00d86-c04e-43ab-b55f-ff93560c0ac7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.783816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.784594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.785026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.785409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.786496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:54.786922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.789142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.809033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 578/1164] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:54.815741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.828044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4d1d-c9ec-4cc9-b9f9-573c40a8be02 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.833888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.834915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.835337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.835741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.848516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.850384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.867104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:54.868311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 587/1165] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:54.875952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.888902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac61f2-f0ca-48f1-9ee9-17b830e733f0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.895008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.895893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.896429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.896737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.897891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:54.898349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.900290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.914360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 579/1166] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:54.921088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.931222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344cf30-af40-4538-8ce2-275f50d6ba4b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.936666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.937488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.937762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.938035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.945825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.949293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:54.966608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:54.968030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 588/1167] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:43:54.974713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:54.985861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa2d5-35dd-486f-bbfe-26d3ca42c47d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:54.991000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:54.992134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:54.992134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:54.992349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:54.993268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:54.993396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:54.995707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf209-44fb-41ef-a77d-34e3b1022547 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:55.009192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 580/1168] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:55.016054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:55.025771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b413-05c2-4f16-a87f-e3767e256865 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:55.030969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:55.031837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:55.032177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:55.032417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] PATH_INFO: `/v3/projects/c74cc4598a854c96b3b095a032553e37/users/9df7a67d7326462582f66270c29c0fd9/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:55.034401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74cc4598a854c96b3b095a032553e37, user_id=9df7a67d7326462582f66270c29c0fd9, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:55.037111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf06de-8617-47d6-8b79-980aaa75184f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:55.051758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 589/1169] 10.222.0.42 () {58 vars in 1460 bytes} [Tue Oct 12 16:43:55 2021] PUT /identity/v3/projects/c74cc4598a854c96b3b095a032553e37/users/9df7a67d7326462582f66270c29c0fd9/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:43:57.429075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a1512-c29c-4767-aa6f-bf2fee284264 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.429589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a1512-c29c-4767-aa6f-bf2fee284264 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.429724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a1512-c29c-4767-aa6f-bf2fee284264 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.431401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 581/1170] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:43:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:57.437662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.438086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.438207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.455400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:57.456563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:57.510286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 590/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:57.535442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a1512-c29c-4767-aa6f-bf2fee284264 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.547428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a1512-c29c-4767-aa6f-bf2fee284264 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.551763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.552533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.552815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.553118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.563025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:43:57.569833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:43:57.570960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 582/1172] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:57.577895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.586547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b6dad-4cea-4dd5-b6b1-d8c63ddf63c2 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.591581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.592214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.592488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.592756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.593549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:57.593850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.595435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.603385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 591/1173] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:43:57.611195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.624274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd745711-3ed3-4a72-9dfe-734d22f407ae admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.631469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.632679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.633141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.633558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.649664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.653290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.676847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:57.678096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 583/1174] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:57.684716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.694403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f8e8-a06c-407b-9c5e-eb53cb593e6a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.699510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.700227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.700509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.700779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.701553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:57.701857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.703431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.715375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 592/1175] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:57.721765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.731184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca703-7c33-42c1-9883-613c353eea5d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.735712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.736486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.736749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.737046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.744006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.746113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.759840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:43:57.761452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 584/1176] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:57.767746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.777877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d83c-6bdb-4eb9-a973-cd8403350f6f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.782373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.783013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.783293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.783567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.784403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:57.784708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.786568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.802916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 593/1177] 10.222.0.42 () {56 vars in 1164 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:57.809077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.818446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd7800-8f50-4ae3-9533-66a8a0a9f448 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.822804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.823905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.824177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.824441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.832039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.833826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.843196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 585/1178] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:57.849243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.858651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb2afb-a2ff-433a-9a9e-37421b1281eb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.863153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.863953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.864238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.864511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.874839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.876665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.893645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:43:57.894763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 594/1179] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:57.900729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.909292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cfae-b13e-4fc3-a186-a9375061e3ee admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.913745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.914360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.914635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.914901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.915606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:57.915905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.917525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.928420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 586/1180] 10.222.0.42 () {56 vars in 1130 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:57.934822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.944196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90d2c-5ece-4f0d-82ab-cc6241702b17 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.949465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.950226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.950508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.950781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.957440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.959380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:57.972001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING keystone.server.flask.application [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:43:57.973120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 595/1181] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:43:57.979304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:57.988550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbda9-b678-48fc-9a09-2fdf9b16de00 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:57.993082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:57.993705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:57.993984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:57.994253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:57.995601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:57.996020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:57.998808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cad88-ecc6-4e0b-b83a-bfe6c6576c87 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:58.012095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 587/1182] 10.222.0.42 () {56 vars in 1169 bytes} [Tue Oct 12 16:43:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:43:58.018711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:58.030502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a623d-13af-46ca-9e13-8a326192f1f8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:58.035158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:58.035805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:58.036084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:58.036355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:58.037240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] RBAC: Adding query filter params (role.id=4fc92071567747e89f2e86ecec30229e, scope.project.id=c74cc4598a854c96b3b095a032553e37, user.id=9df7a67d7326462582f66270c29c0fd9) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:43:58.037557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:58.039402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f631c-1f72-4928-8bf4-092b0b525e9f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:58.045770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 596/1183] 10.222.0.42 () {56 vars in 1395 bytes} [Tue Oct 12 16:43:58 2021] GET /identity/v3/role_assignments?user.id=9df7a67d7326462582f66270c29c0fd9&scope.project.id=c74cc4598a854c96b3b095a032553e37&role.id=4fc92071567747e89f2e86ecec30229e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:00.258360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52816-f204-4449-9ca2-449125ca96bd None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.258918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52816-f204-4449-9ca2-449125ca96bd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.258918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e52816-f204-4449-9ca2-449125ca96bd None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.260708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 588/1184] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:44:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:00.266566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.266976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.267115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.284355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:00.285570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:00.293945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 597/1185] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:00.316830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e52816-f204-4449-9ca2-449125ca96bd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:00.328893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e52816-f204-4449-9ca2-449125ca96bd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:00.333306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:00.334074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.334356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.334627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.335282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:00.336863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:00.348130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:44:00.349271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 589/1186] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:44:00 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:44:00.356198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:00.365351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015b4d-4582-4bba-96d2-64b9a3a4c31f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:00.369892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:00.370530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.370808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.371078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.371789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:00.372092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:00.373715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dee6d1-a210-4d9b-9755-56d27b68ddb2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:00.378740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 598/1187] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Oct 12 16:44:00 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:00.384733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:00.394119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f169ec-40fe-41fb-912c-65a375f7a81a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:00.398644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:00.399269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:00.399549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:00.399825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] PATH_INFO: `/v3/services` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:00.400525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:00.400828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:00.402956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427889-cd23-4b6c-bc1c-2b81de179eaf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:00.407221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 590/1188] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Oct 12 16:44:00 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:44:02.687599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bee81-b1fd-4d50-9715-4d07c5fa2882 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.688166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bee81-b1fd-4d50-9715-4d07c5fa2882 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.688166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bee81-b1fd-4d50-9715-4d07c5fa2882 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.689973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 599/1189] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:44:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:02.695872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c9fa-034f-40c9-8332-165ef917e744 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.696288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c9fa-034f-40c9-8332-165ef917e744 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.696394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c9fa-034f-40c9-8332-165ef917e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.714021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-26d5c9fa-034f-40c9-8332-165ef917e744 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:02.715179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-26d5c9fa-034f-40c9-8332-165ef917e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:02.722672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 591/1190] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:44:02.746470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bee81-b1fd-4d50-9715-4d07c5fa2882 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:02.758719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bee81-b1fd-4d50-9715-4d07c5fa2882 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:02.763130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:02.763760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:02.764041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:02.764312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:02.765081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:02.766662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5ccd7-b78f-45d6-a411-2f6b08086a30 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:02.779319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 600/1191] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 12 16:44:02 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:44:05.014206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a282b-8eab-4d72-9bee-f44675d4284a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.014742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a282b-8eab-4d72-9bee-f44675d4284a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.014742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a282b-8eab-4d72-9bee-f44675d4284a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.016522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 592/1192] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:44:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:05.022417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.022798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.022977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.040557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:05.042286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:05.061092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 601/1193] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:44:05.085034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a282b-8eab-4d72-9bee-f44675d4284a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:05.097196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a282b-8eab-4d72-9bee-f44675d4284a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:05.101503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:05.102276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.102551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.102816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.103471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:05.105584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:05.116276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:44:05.117422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 593/1194] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:44:05 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:44:05.124896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:05.134122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0101ee-2772-4f04-ba6d-a403f0ba4b3e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:05.138825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:05.139476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.139755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.140026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.140882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:05.141221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:05.142804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:05.148012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 602/1195] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Oct 12 16:44:05 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:05.154984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:05.164754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6551-12af-4b15-9b60-49e636140c62 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:05.170314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:05.170949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.171237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.171511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.172303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] RBAC: Adding query filter params (interface=public, service_id=02729c7c85a544d69ade068803892731, region_id=RegionOne) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:05.172615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:05.174244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df41f36-d9c9-4f7c-9a84-31687e46a84e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:05.179305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 594/1196] 10.222.0.42 () {56 vars in 1272 bytes} [Tue Oct 12 16:44:05 2021] GET /identity/v3/endpoints?service_id=02729c7c85a544d69ade068803892731&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:05.186197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:05.195617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8748-fc38-41bb-8853-7a03e3a6c559 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:05.200086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:05.200716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:05.201040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:05.201313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:05.201989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:05.203552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f356fa-df1f-4642-ab9b-bec38af0a41d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:05.210121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 603/1197] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:44:05 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:44:07.459173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c69b1-02a5-4436-9e8e-d680605e4f50 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.459696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c69b1-02a5-4436-9e8e-d680605e4f50 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.459696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c69b1-02a5-4436-9e8e-d680605e4f50 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.461522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 595/1198] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:44:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:07.468054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.468440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.468611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.485816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:07.486997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:07.494612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 604/1199] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:44:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:07.519474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c69b1-02a5-4436-9e8e-d680605e4f50 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:07.531901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c69b1-02a5-4436-9e8e-d680605e4f50 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:07.536308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:07.537128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.537413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.537685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.538340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:07.539933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:07.551296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING keystone.server.flask.application [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:44:07.552399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 596/1200] 10.222.0.42 () {56 vars in 1138 bytes} [Tue Oct 12 16:44:07 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:44:07.559733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:07.568645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d40f7-9377-440f-aae7-43809a55b89a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:07.573219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:07.573862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.574147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.574426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] PATH_INFO: `/v3/services` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.575143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:07.575450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:07.577055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76183-bf60-495b-a735-2e98b7d8b3a0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:07.582172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 605/1201] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Oct 12 16:44:07 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:07.587983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:07.598212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7656f-7fbf-4c93-ad5f-7838abdc1fac admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:07.602617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:07.603242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:07.603515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:07.603793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:07.605255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:07.606809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51d94d-8bf0-4ad7-8546-826115a76e56 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:07.628983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 597/1202] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 12 16:44:07 2021] POST /identity/v3/endpoints => generated 331 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:45:10.861541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:10.862036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:10.862582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:10.872404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb0c7-4458-458d-b3f6-ff4e9d005c74 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:10.872865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb0c7-4458-458d-b3f6-ff4e9d005c74 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:10.873267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb0c7-4458-458d-b3f6-ff4e9d005c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:10.876173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 606/1203] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:10 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:11.000805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b53cb0c7-4458-458d-b3f6-ff4e9d005c74 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:11.003914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b53cb0c7-4458-458d-b3f6-ff4e9d005c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:11.140066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 598/1204] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:11.164984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:11.166958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:11.295484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85df9e-cac4-4c41-9029-a121d81d18dc None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:11.392133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:11.392790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:11.393100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:11.393380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:11.394114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:11.395964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02188585-82e1-4026-951f-59bced882b41 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:11.416594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 607/1205] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:45:11 2021] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:45:13.705707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa10fbe-881b-4354-b424-aafbcd237e6c None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:13.706274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa10fbe-881b-4354-b424-aafbcd237e6c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:13.706560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa10fbe-881b-4354-b424-aafbcd237e6c None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:13.708347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 599/1206] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:13.714288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e250-06b4-4e4f-8344-494b53915bf4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:13.714754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e250-06b4-4e4f-8344-494b53915bf4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:13.714853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864e250-06b4-4e4f-8344-494b53915bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:13.781236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5864e250-06b4-4e4f-8344-494b53915bf4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:13.782417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5864e250-06b4-4e4f-8344-494b53915bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:13.873263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 608/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:13.924840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:13.925160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:13.925440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:13.927302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 600/1208] 10.222.0.42 () {54 vars in 963 bytes} [Tue Oct 12 16:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:13.933846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85459-833b-4407-bec1-a91f0f71ca2c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:13.934132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85459-833b-4407-bec1-a91f0f71ca2c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:13.934403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85459-833b-4407-bec1-a91f0f71ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:14.005365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f1a85459-833b-4407-bec1-a91f0f71ca2c None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:14.006471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f1a85459-833b-4407-bec1-a91f0f71ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:14.076747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 609/1209] 10.222.0.42 () {58 vars in 1060 bytes} [Tue Oct 12 16:45:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:14.086255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:14.087760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:14.187884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a7ad-baf7-446e-85bc-ab88802bc75f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:14.257634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:14.258252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:14.258535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:14.258811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:14.260512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:14.365590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:14.367020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a18d7-0b62-4fee-8fd0-75aee8960aa4 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:14.384532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 601/1210] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:45:16.922492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:16.923042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:16.923042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:16.924997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 610/1211] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:16.930661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c4e-8762-444b-bdef-4506a71ff843 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:16.931067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c4e-8762-444b-bdef-4506a71ff843 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:16.931347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c4e-8762-444b-bdef-4506a71ff843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:16.994485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d6388c4e-8762-444b-bdef-4506a71ff843 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:16.995603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d6388c4e-8762-444b-bdef-4506a71ff843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:17.088868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 602/1212] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:17.128317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:17.129913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:17.231028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999353f-3fea-47cd-be2d-142dbe1489d4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:17.302577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:17.303239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:17.303519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:17.303786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:17.305535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:17.410320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:17.411779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3ba4-fe8e-4475-b676-1a5639359155 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:17.437743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 611/1213] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:20.004875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:20.005501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:20.005501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:20.007258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 603/1214] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:20.013762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:20.014202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:20.014298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:20.076584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:20.077825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:20.175863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 612/1215] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:20.211767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:20.213385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:20.331564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c7df-6e38-4a37-a326-c0797978d275 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:20.419815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:20.420664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:20.420939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:20.421230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:20.430909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:20.433055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f75ec-b3d0-4419-9344-51d971d32842 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:20.434794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 604/1216] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:45:20 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:45:20.447547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:20.448745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:20.534750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc392c-00ec-49d4-a202-d8117ec6043a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:20.604219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:20.604783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:20.605098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:20.605374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:20.607097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:20.709084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:20.710515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377765c-06b5-4ae9-aace-e32fdc4f8908 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:20.729036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 613/1217] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:23.485974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:23.486529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:23.486529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:23.488356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 605/1218] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:23.494836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b99bc-d845-4016-a91e-7fc485260c8a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:23.495277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b99bc-d845-4016-a91e-7fc485260c8a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:23.495378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b99bc-d845-4016-a91e-7fc485260c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:23.559157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a09b99bc-d845-4016-a91e-7fc485260c8a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:23.560277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a09b99bc-d845-4016-a91e-7fc485260c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:23.653369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 614/1219] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:23.688315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:23.689855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:23.809793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963ae98-4961-4682-bf87-04e7e55b52f5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:23.898048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:23.899494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:23.899768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:23.900035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:23.909759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:23.911798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3f38f-3538-481a-b5b6-be27ba1d7a59 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:23.913582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 606/1220] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:45:23 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:45:23.942306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:23.942588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:23.942863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:23.944669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 615/1221] 10.222.0.42 () {54 vars in 963 bytes} [Tue Oct 12 16:45:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:23.951623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568067b7-9147-42e9-aa51-fe1dd3b9056a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:23.951906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568067b7-9147-42e9-aa51-fe1dd3b9056a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:23.952181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568067b7-9147-42e9-aa51-fe1dd3b9056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:24.024732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-568067b7-9147-42e9-aa51-fe1dd3b9056a None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:24.025957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-568067b7-9147-42e9-aa51-fe1dd3b9056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:24.097498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 607/1222] 10.222.0.42 () {58 vars in 1060 bytes} [Tue Oct 12 16:45:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:24.106925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:24.108452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:24.207477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210c4c1-fbda-4c28-9093-d8baf7104d17 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:24.280451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:24.281134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:24.281419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:24.281694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:24.283325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:24.389113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:24.390471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749708-0bcd-42da-b8d7-6ccff2e4036c service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:24.407617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 616/1223] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:27.843449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:27.844027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:27.844027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:27.845830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 608/1224] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:27.852789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b9da-ab51-4098-893c-725c689fae03 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:27.853368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b9da-ab51-4098-893c-725c689fae03 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:27.853368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b9da-ab51-4098-893c-725c689fae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:27.921279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1148b9da-ab51-4098-893c-725c689fae03 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:27.922220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1148b9da-ab51-4098-893c-725c689fae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:28.018557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 617/1225] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:28.057111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:28.058638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:28.159160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd249-9d9b-4f35-9fd9-415343669919 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:28.229538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:28.230194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:28.230477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:28.230754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:28.232371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:28.337372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:28.338795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378de9e2-73b6-49b1-8e3f-07bf8bda39cf service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:28.356594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 609/1226] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:30.712305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:30.712872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:30.712872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:30.714684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 618/1227] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:30.721162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2424-6066-4fb7-8c48-c2b3ec4da092 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:30.721586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2424-6066-4fb7-8c48-c2b3ec4da092 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:30.721586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2424-6066-4fb7-8c48-c2b3ec4da092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:30.805354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-77ab2424-6066-4fb7-8c48-c2b3ec4da092 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:30.807119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-77ab2424-6066-4fb7-8c48-c2b3ec4da092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:30.901929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 610/1228] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:30.940052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:30.941648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:31.041746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6409079-1118-491a-93b8-60cd361f0262 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:31.129853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:31.130517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:31.130812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:31.131089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:31.133085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:31.262289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:31.263751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e12dcd-d6d3-4b0f-aa2a-5cf038cfa349 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:31.281715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 619/1229] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:45:33.576203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:33.576718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:33.576718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:33.578505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 611/1230] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:33.584531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:33.584932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:33.585113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:33.655011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:33.656210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:33.747512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 620/1231] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:33.782301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:33.783822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:33.902344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0482b6-0135-45aa-ba1a-ea28c9d1ff88 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:33.991585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:33.992929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:33.993236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:33.993509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:34.003385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:34.005481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e570f1-7027-4821-a428-f21a3b4905a0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:34.007233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 612/1232] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:45:33 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:45:34.019960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:34.021225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:34.110463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d279-e094-4fec-864b-e596403d7a43 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:34.182843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:34.183473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:34.183773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:34.184028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:34.185694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:34.290771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:34.292208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b6b4-0298-428c-a76c-6ce662fb4abe service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:34.310337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 621/1233] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:36.816909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:36.817506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:36.817506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:36.819463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 613/1234] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:36.826610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8915de-3dc0-4497-96fa-7dc34d0f4ec9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:36.827132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8915de-3dc0-4497-96fa-7dc34d0f4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:36.827132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8915de-3dc0-4497-96fa-7dc34d0f4ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:36.893190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ba8915de-3dc0-4497-96fa-7dc34d0f4ec9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:36.894376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ba8915de-3dc0-4497-96fa-7dc34d0f4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:36.986296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 622/1235] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:37.024885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:37.026453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:37.136557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720f98-27ac-424b-b27e-089c1988bd07 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:37.205851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:37.206488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:37.206761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:37.207029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:37.208623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:37.318525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:37.320439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d99e-8fea-44d2-b9f4-0ba2d419d682 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:37.338378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 614/1236] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:39.613507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:39.614026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:39.614026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:39.615728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 623/1237] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:39.622182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155030e-a690-4df8-9eca-f9973cc05301 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:39.622588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155030e-a690-4df8-9eca-f9973cc05301 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:39.622756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155030e-a690-4df8-9eca-f9973cc05301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:39.685268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3155030e-a690-4df8-9eca-f9973cc05301 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:39.686465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3155030e-a690-4df8-9eca-f9973cc05301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:39.783825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 615/1238] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:39.825801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:39.827357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:39.925114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ccbf8-fda5-4240-b955-98a2bd84b3f4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:39.993694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:39.994331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:39.994610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:39.994883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:39.996501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:40.100073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:40.102148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6919969-b795-4000-9a2a-61f7b1d15fd2 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:40.119069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 624/1239] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:42.785681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:42.786179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:42.786267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:42.788009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 616/1240] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:42.794689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39e7ea-f96c-48e9-b3c3-6982b9ec9f3f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:42.795260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39e7ea-f96c-48e9-b3c3-6982b9ec9f3f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:42.795537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39e7ea-f96c-48e9-b3c3-6982b9ec9f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:42.867918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-de39e7ea-f96c-48e9-b3c3-6982b9ec9f3f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:42.869121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-de39e7ea-f96c-48e9-b3c3-6982b9ec9f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:42.967036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 625/1241] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:45:43.004758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:43.006926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:43.096838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0458f-e665-469c-b284-c54d0597a7ad None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:43.100404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:43.101275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:43.101576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:43.101858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:43.110474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:43.111993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a50577-e0e9-4769-beb4-cf1bd9e62e6b service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:43.121537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 617/1242] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:47.325714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc0d4-66be-47e9-92d3-87e4e38d3f2e None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:47.326212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc0d4-66be-47e9-92d3-87e4e38d3f2e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:47.326329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc0d4-66be-47e9-92d3-87e4e38d3f2e None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:47.328083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 626/1243] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:47.334203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d41b-1048-4193-aec5-4576740e8169 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:47.334627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d41b-1048-4193-aec5-4576740e8169 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:47.334873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d41b-1048-4193-aec5-4576740e8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:47.352489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5883d41b-1048-4193-aec5-4576740e8169 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:47.353684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5883d41b-1048-4193-aec5-4576740e8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:47.361391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 618/1244] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:47.403180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc0d4-66be-47e9-92d3-87e4e38d3f2e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:47.413708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc0d4-66be-47e9-92d3-87e4e38d3f2e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:47.417296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:47.417929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:47.418203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:47.418469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:47.427695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:47.429692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9f8cb-264e-41ac-8437-c7fd119b9b49 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:47.439179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 627/1245] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:50.280726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68d41-c008-459f-889c-b8b86fdfc7c4 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.281350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68d41-c008-459f-889c-b8b86fdfc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.281350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68d41-c008-459f-889c-b8b86fdfc7c4 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.283109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 619/1246] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:50.289182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98668d-e945-4b83-b0b0-5e5cfc0b6c80 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.289569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98668d-e945-4b83-b0b0-5e5cfc0b6c80 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.289730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98668d-e945-4b83-b0b0-5e5cfc0b6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.307035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8b98668d-e945-4b83-b0b0-5e5cfc0b6c80 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:50.308233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8b98668d-e945-4b83-b0b0-5e5cfc0b6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:50.316078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 628/1247] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:50.359930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa68d41-c008-459f-889c-b8b86fdfc7c4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:50.371001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa68d41-c008-459f-889c-b8b86fdfc7c4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:50.374471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:50.375091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:50.375385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:50.375640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:50.385047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:50.386452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35427-9afc-4776-b05c-09b2c70dc0d2 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:50.395546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 620/1248] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:54.737551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc39-0525-4114-a628-4a48db7339a7 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:54.738104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc39-0525-4114-a628-4a48db7339a7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:54.738104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cc39-0525-4114-a628-4a48db7339a7 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:54.739801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 629/1249] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:45:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:54.745864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451320a2-9ec0-4222-8d3d-168f1d95614a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:54.746336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451320a2-9ec0-4222-8d3d-168f1d95614a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:54.746428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451320a2-9ec0-4222-8d3d-168f1d95614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:54.764603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-451320a2-9ec0-4222-8d3d-168f1d95614a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:45:54.765823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-451320a2-9ec0-4222-8d3d-168f1d95614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:45:54.774250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 621/1250] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:45:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:45:54.812972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29cc39-0525-4114-a628-4a48db7339a7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:45:54.823902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29cc39-0525-4114-a628-4a48db7339a7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:45:54.827483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:45:54.828113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:54.828386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:54.828653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:54.838219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:45:54.839648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63ceb-210a-4737-8750-b4afc635052e service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:45:54.848976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 630/1251] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:45:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:45:59.893645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d91b9-6cd7-4d13-ba6a-bb72934e4c54 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:59.894141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d91b9-6cd7-4d13-ba6a-bb72934e4c54 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:59.894596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d91b9-6cd7-4d13-ba6a-bb72934e4c54 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:45:59.901290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 622/1252] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:45:59 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:45:59.904271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c48e-7a77-4be5-a0d9-f0d1149624f8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:45:59.904710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c48e-7a77-4be5-a0d9-f0d1149624f8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:45:59.905142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c48e-7a77-4be5-a0d9-f0d1149624f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:00.040723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2ce8c48e-7a77-4be5-a0d9-f0d1149624f8 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:00.042370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ce8c48e-7a77-4be5-a0d9-f0d1149624f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:00.121847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 631/1253] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:45:59 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:04.509456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc751-770a-4827-8566-dd849312e637 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:04.509970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc751-770a-4827-8566-dd849312e637 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:04.510264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc751-770a-4827-8566-dd849312e637 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:04.512572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 623/1254] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:46:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:04.517987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8297c24-7661-486b-9ab7-064180031a62 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:04.518496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8297c24-7661-486b-9ab7-064180031a62 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:04.518766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8297c24-7661-486b-9ab7-064180031a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:04.538176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a8297c24-7661-486b-9ab7-064180031a62 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:04.539531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a8297c24-7661-486b-9ab7-064180031a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:04.548506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 632/1255] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:46:04 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:05.910796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f619-40d6-4e8c-88a5-347ea5a68c6d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:05.911310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f619-40d6-4e8c-88a5-347ea5a68c6d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:05.911310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f619-40d6-4e8c-88a5-347ea5a68c6d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:05.913146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 624/1256] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:46:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:05.918744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb78b-c61c-401f-aa91-fa8674a93f13 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:05.919246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb78b-c61c-401f-aa91-fa8674a93f13 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:05.919246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfb78b-c61c-401f-aa91-fa8674a93f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:05.943669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6edfb78b-c61c-401f-aa91-fa8674a93f13 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:05.945492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6edfb78b-c61c-401f-aa91-fa8674a93f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:05.954160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 633/1257] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:46:05 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:09.858744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896ece-41cd-4fd5-a8e1-be4144bea10d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:09.859235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896ece-41cd-4fd5-a8e1-be4144bea10d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:09.859235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896ece-41cd-4fd5-a8e1-be4144bea10d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:09.861121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 625/1258] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:09.867292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcd35f-f642-493d-addb-75c5c6225a3d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:09.868077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcd35f-f642-493d-addb-75c5c6225a3d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:09.868356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcd35f-f642-493d-addb-75c5c6225a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:09.887169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-abfcd35f-f642-493d-addb-75c5c6225a3d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:09.888356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-abfcd35f-f642-493d-addb-75c5c6225a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:09.896137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 634/1259] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:09.947772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb29db-a10c-4763-88b6-35b97efb7936 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:09.948222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb29db-a10c-4763-88b6-35b97efb7936 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:09.948593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb29db-a10c-4763-88b6-35b97efb7936 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:09.950498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 626/1260] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:46:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:09.956495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82a75-70e5-4bfe-909a-8222e3cc7eec None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:09.956855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82a75-70e5-4bfe-909a-8222e3cc7eec None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:09.957230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82a75-70e5-4bfe-909a-8222e3cc7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:10.007775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-82b82a75-70e5-4bfe-909a-8222e3cc7eec None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:10.009520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-82b82a75-70e5-4bfe-909a-8222e3cc7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:10.092756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 635/1261] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:46:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:10.101159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb29db-a10c-4763-88b6-35b97efb7936 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:10.117585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb29db-a10c-4763-88b6-35b97efb7936 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:10.123374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:10.124296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:10.125049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:10.125480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:10.135388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:10.137416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b597-3b40-4a98-bd2d-4af293f1d64a service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:10.147455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 627/1262] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:46:12.665926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15f91-7131-40a6-8d46-2aad1174d782 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:12.666370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15f91-7131-40a6-8d46-2aad1174d782 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:12.666470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15f91-7131-40a6-8d46-2aad1174d782 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:12.668417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 636/1263] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:12.674363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770f1-23ee-43fe-903e-1425fde409c4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:12.674782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770f1-23ee-43fe-903e-1425fde409c4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:12.674900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba770f1-23ee-43fe-903e-1425fde409c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:12.692417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9ba770f1-23ee-43fe-903e-1425fde409c4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:12.694444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9ba770f1-23ee-43fe-903e-1425fde409c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:12.706913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 628/1264] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:12.749486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15f91-7131-40a6-8d46-2aad1174d782 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:12.765266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15f91-7131-40a6-8d46-2aad1174d782 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:12.770701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:12.771466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:12.771742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:12.772559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:12.780638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:12.782259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0fef-cfcd-4b01-a2aa-3d698936ff5e service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:12.791929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 637/1265] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:15.373053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ad20-610b-44bf-bab6-13e034657ad7 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:15.373894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ad20-610b-44bf-bab6-13e034657ad7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:15.374331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ad20-610b-44bf-bab6-13e034657ad7 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:15.376166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 629/1266] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:15.383884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32ea5-b0a2-459c-9ea8-edc7544e2e2a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:15.384423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32ea5-b0a2-459c-9ea8-edc7544e2e2a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:15.384423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a32ea5-b0a2-459c-9ea8-edc7544e2e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:15.407031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-16a32ea5-b0a2-459c-9ea8-edc7544e2e2a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:15.409102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-16a32ea5-b0a2-459c-9ea8-edc7544e2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:15.420863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 638/1267] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:15.471325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19e3c-a8e1-412f-9980-4cfbada16fb9 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:15.471541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19e3c-a8e1-412f-9980-4cfbada16fb9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:15.471817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e19e3c-a8e1-412f-9980-4cfbada16fb9 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:15.473680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 630/1268] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:46:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:15.480912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabcbc4-b959-4fe9-bb1e-4e0a006587e8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:15.481101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabcbc4-b959-4fe9-bb1e-4e0a006587e8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:15.481345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabcbc4-b959-4fe9-bb1e-4e0a006587e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:15.502772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9eabcbc4-b959-4fe9-bb1e-4e0a006587e8 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:15.504835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9eabcbc4-b959-4fe9-bb1e-4e0a006587e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:15.515727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 639/1269] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:46:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:15.523863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e19e3c-a8e1-412f-9980-4cfbada16fb9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:15.540976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e19e3c-a8e1-412f-9980-4cfbada16fb9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:15.545506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:15.546239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:15.546585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:15.546940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:15.557419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:15.559017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebdc2b-24ea-4d1f-8111-44dadcb74214 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:15.569455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 631/1270] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:17.753052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f79-377c-4f53-9107-19910c999424 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.753614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f79-377c-4f53-9107-19910c999424 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.753614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8f79-377c-4f53-9107-19910c999424 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.755386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 640/1271] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:17.761618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc07a-391c-4ff9-aeca-a681a97f5197 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.762062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc07a-391c-4ff9-aeca-a681a97f5197 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.762160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc07a-391c-4ff9-aeca-a681a97f5197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.779945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3adcc07a-391c-4ff9-aeca-a681a97f5197 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:17.781163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3adcc07a-391c-4ff9-aeca-a681a97f5197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:17.789742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 632/1272] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:46:17.849300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5679-af09-482b-b49f-0785b550220f None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.849566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5679-af09-482b-b49f-0785b550220f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.850373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5679-af09-482b-b49f-0785b550220f None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.852463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 641/1273] 10.222.0.42 () {54 vars in 962 bytes} [Tue Oct 12 16:46:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:17.858824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15497-ebe2-4a67-8a00-aa8f5add8f63 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.859193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15497-ebe2-4a67-8a00-aa8f5add8f63 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.859375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15497-ebe2-4a67-8a00-aa8f5add8f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.915328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d8d15497-ebe2-4a67-8a00-aa8f5add8f63 None None] MFA Rules not processed for user `1052f3aba4c24b1aab7ec4ddf46cf820`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:17.916538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d8d15497-ebe2-4a67-8a00-aa8f5add8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:17.976181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 633/1274] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Oct 12 16:46:17 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:17.985535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe5679-af09-482b-b49f-0785b550220f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:17.996770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe5679-af09-482b-b49f-0785b550220f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:18.001117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:18.001758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:18.002211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:18.002877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:18.008613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbcb1-d57e-4b62-845d-296a0f5a6565 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:18.008827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbcb1-d57e-4b62-845d-296a0f5a6565 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:18.009298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbcb1-d57e-4b62-845d-296a0f5a6565 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:18.012761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:18.014261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:18.015497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 634/1275] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:46:18.016850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeb23a-6bc8-4a2e-b72d-2a60f0ba7ad0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:18.017171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeb23a-6bc8-4a2e-b72d-2a60f0ba7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:18.017446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeb23a-6bc8-4a2e-b72d-2a60f0ba7ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:18.024444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 642/1276] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:18.035088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-dfdeb23a-6bc8-4a2e-b72d-2a60f0ba7ad0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:18.036297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-dfdeb23a-6bc8-4a2e-b72d-2a60f0ba7ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:18.045055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 635/1277] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:18.092796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:18.108065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeac0e-20b9-4e4a-b08c-ca39e48c4da8 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:18.113998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:18.114786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:18.115144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:18.115705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:18.123976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:18.125793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b684ed-c425-4f42-867e-2147d8b3747f service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:18.135997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 643/1278] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:20.432068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433759b-910f-4324-a39b-47b5cd6bd5cd None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:20.432575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433759b-910f-4324-a39b-47b5cd6bd5cd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:20.432670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433759b-910f-4324-a39b-47b5cd6bd5cd None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:20.434410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 636/1279] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:20.440225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce363-a7e2-478c-8a52-0246882e4e57 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:20.440650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce363-a7e2-478c-8a52-0246882e4e57 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:20.440766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ce363-a7e2-478c-8a52-0246882e4e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:20.458069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-307ce363-a7e2-478c-8a52-0246882e4e57 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:20.459737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-307ce363-a7e2-478c-8a52-0246882e4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:20.467500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 644/1280] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:20.513353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433759b-910f-4324-a39b-47b5cd6bd5cd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:20.527806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433759b-910f-4324-a39b-47b5cd6bd5cd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:20.533277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:20.533892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:20.534170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:20.534439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:20.547216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:20.548832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df9fed-1d66-4be9-8966-bfdfc9fdaf32 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:20.558293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 637/1281] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:22.856333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9935-cb11-465d-a3b4-5e00e584d34a None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.856909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9935-cb11-465d-a3b4-5e00e584d34a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.856909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9935-cb11-465d-a3b4-5e00e584d34a None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.858689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 645/1282] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:46:22.864582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81951a-2f8d-4ce5-a848-22405dcb6e24 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.865145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81951a-2f8d-4ce5-a848-22405dcb6e24 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.865145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81951a-2f8d-4ce5-a848-22405dcb6e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.882998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ed81951a-2f8d-4ce5-a848-22405dcb6e24 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:22.884172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ed81951a-2f8d-4ce5-a848-22405dcb6e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:22.891951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 638/1283] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:22.939667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c9935-cb11-465d-a3b4-5e00e584d34a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:22.955224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c9935-cb11-465d-a3b4-5e00e584d34a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:22.961380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:22.962127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.962506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.962903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.971810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:22.973533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2a589-4189-4917-a876-cd6cfdaa9a8c service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:22.984188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 646/1284] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:25.343031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea23f-570a-47b6-bd38-eb870826bb27 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:25.343513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea23f-570a-47b6-bd38-eb870826bb27 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:25.343606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ea23f-570a-47b6-bd38-eb870826bb27 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:25.345405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 639/1285] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:25.352114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d643-c284-4999-9363-b2c409f1fb6a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:25.352520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d643-c284-4999-9363-b2c409f1fb6a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:25.352670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d643-c284-4999-9363-b2c409f1fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:25.371305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0825d643-c284-4999-9363-b2c409f1fb6a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:25.372510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0825d643-c284-4999-9363-b2c409f1fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:25.380724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 647/1286] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:25.425395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ea23f-570a-47b6-bd38-eb870826bb27 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:25.440711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ea23f-570a-47b6-bd38-eb870826bb27 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:25.446600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:25.447219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:25.447496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:25.447764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:25.456342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:25.458111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae91f-592d-4764-9180-ca4fc0cbdb26 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:25.468020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 640/1287] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:27.744142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0e3d-98c3-403e-9a7d-61834874af4e None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:27.744693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0e3d-98c3-403e-9a7d-61834874af4e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:27.744693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0e3d-98c3-403e-9a7d-61834874af4e None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:27.746503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 648/1288] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:27.753877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323dd9f-eaf8-40b3-ab56-563dcb05a094 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:27.754333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323dd9f-eaf8-40b3-ab56-563dcb05a094 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:27.754437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323dd9f-eaf8-40b3-ab56-563dcb05a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:27.774101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e323dd9f-eaf8-40b3-ab56-563dcb05a094 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:27.775587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e323dd9f-eaf8-40b3-ab56-563dcb05a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:27.784317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 641/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:27.848894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0e3d-98c3-403e-9a7d-61834874af4e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:27.863375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0e3d-98c3-403e-9a7d-61834874af4e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:27.868672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:27.869321 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:27.869602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:27.869865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:27.878181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:27.879759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535d5ff-2ffd-4720-9baf-4c2a55fd0ae1 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:27.889219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 649/1290] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:30.165471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01882-989c-4f22-b760-9ac84cc63388 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:30.166057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01882-989c-4f22-b760-9ac84cc63388 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:30.166202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d01882-989c-4f22-b760-9ac84cc63388 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:30.168592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 642/1291] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:30.175008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09b6bb-94f5-451d-9732-6eab462e418e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:30.175444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09b6bb-94f5-451d-9732-6eab462e418e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:30.175718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09b6bb-94f5-451d-9732-6eab462e418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:30.197798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4b09b6bb-94f5-451d-9732-6eab462e418e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:30.199820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4b09b6bb-94f5-451d-9732-6eab462e418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:30.210886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 650/1292] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:46:30.258919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d01882-989c-4f22-b760-9ac84cc63388 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:30.274077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d01882-989c-4f22-b760-9ac84cc63388 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:30.279675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:30.280311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:30.280595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:30.280876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:30.290871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:30.293338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f90d-c2aa-450c-88b7-186851ed50f6 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:30.305951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 643/1293] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:32.649913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c939-7bd1-4557-940e-e493cf119d20 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:32.650519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c939-7bd1-4557-940e-e493cf119d20 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:32.650519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88c939-7bd1-4557-940e-e493cf119d20 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:32.652164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 651/1294] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:32.658809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc6aa-7206-4f75-a795-fb45f0162a77 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:32.659254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc6aa-7206-4f75-a795-fb45f0162a77 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:32.659494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc6aa-7206-4f75-a795-fb45f0162a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:32.680005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b9efc6aa-7206-4f75-a795-fb45f0162a77 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:32.681206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b9efc6aa-7206-4f75-a795-fb45f0162a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:32.689534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 644/1295] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:32.744691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88c939-7bd1-4557-940e-e493cf119d20 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:32.758942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88c939-7bd1-4557-940e-e493cf119d20 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:32.764708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:32.765367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:32.765645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:32.765909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:32.773910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:32.775519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08396298-b053-4a4a-858d-d9a04f057777 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:32.785217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 652/1296] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:35.078590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a8305-30ac-426d-a154-de84894dc43d None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.079086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a8305-30ac-426d-a154-de84894dc43d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.079086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a8305-30ac-426d-a154-de84894dc43d None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.080840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 645/1297] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:35.086881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced36d-a7e8-48d5-a8d6-48b3b449bba1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.087314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced36d-a7e8-48d5-a8d6-48b3b449bba1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.087439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced36d-a7e8-48d5-a8d6-48b3b449bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.105804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3fced36d-a7e8-48d5-a8d6-48b3b449bba1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:35.108844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3fced36d-a7e8-48d5-a8d6-48b3b449bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:35.116915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 653/1298] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:35.163986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a8305-30ac-426d-a154-de84894dc43d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:35.178429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a8305-30ac-426d-a154-de84894dc43d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:35.183807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:35.184430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.184707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.185004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.192979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:35.195029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18e53-fa7f-4b49-b46d-ba3f34230741 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:35.204631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 646/1299] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:35.665110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20bec-9873-4e5a-98d4-fdbb4a33f758 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.665424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20bec-9873-4e5a-98d4-fdbb4a33f758 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.665697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20bec-9873-4e5a-98d4-fdbb4a33f758 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.667491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 654/1300] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:35.673340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2863828-0850-4ffb-a01a-0f9b46abb036 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.673690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2863828-0850-4ffb-a01a-0f9b46abb036 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.674034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2863828-0850-4ffb-a01a-0f9b46abb036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.691565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f2863828-0850-4ffb-a01a-0f9b46abb036 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:35.692736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2863828-0850-4ffb-a01a-0f9b46abb036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:35.700902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 647/1301] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:35.758741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c228d-f9ef-4897-88fb-d63ff8edf2ea None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.759049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c228d-f9ef-4897-88fb-d63ff8edf2ea None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.759328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c228d-f9ef-4897-88fb-d63ff8edf2ea None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.762324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 655/1302] 10.222.0.42 () {54 vars in 961 bytes} [Tue Oct 12 16:46:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:35.767798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86237d1-55cc-482f-b57d-32b9da832328 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.768086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86237d1-55cc-482f-b57d-32b9da832328 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.768364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86237d1-55cc-482f-b57d-32b9da832328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.816537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e86237d1-55cc-482f-b57d-32b9da832328 None None] MFA Rules not processed for user `e5854e1cb2f34a049f72909a002dde73`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:35.817760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e86237d1-55cc-482f-b57d-32b9da832328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:35.874537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 648/1303] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Oct 12 16:46:35 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:46:35.883482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c228d-f9ef-4897-88fb-d63ff8edf2ea None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:35.894086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c228d-f9ef-4897-88fb-d63ff8edf2ea None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:35.898808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:35.899561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.899843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.900119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.909277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:35.910699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0d47e-6d71-4a15-9042-ba7575754ed5 service glance] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:35.919823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 656/1304] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:36.361174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701286de-5df3-469b-8404-6d031f5f368c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:36.361672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701286de-5df3-469b-8404-6d031f5f368c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:36.361971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701286de-5df3-469b-8404-6d031f5f368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:36.410045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-701286de-5df3-469b-8404-6d031f5f368c None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:36.411258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-701286de-5df3-469b-8404-6d031f5f368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:36.476420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 649/1305] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:46:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:46:36.523178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701dd7-91a1-4c38-a7ef-57bdf728fc32 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:36.523664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701dd7-91a1-4c38-a7ef-57bdf728fc32 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:36.523866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c701dd7-91a1-4c38-a7ef-57bdf728fc32 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:36.525875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 657/1306] 10.222.0.42 () {54 vars in 942 bytes} [Tue Oct 12 16:46:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:46:36.532965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d5fb-ab3c-40d6-9499-6d4c4a29fe21 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:36.533265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d5fb-ab3c-40d6-9499-6d4c4a29fe21 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:36.533544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d5fb-ab3c-40d6-9499-6d4c4a29fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:36.582080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e801d5fb-ab3c-40d6-9499-6d4c4a29fe21 None None] MFA Rules not processed for user `e3be860ad77f429ab00e7ce038b7c735`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:36.583288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e801d5fb-ab3c-40d6-9499-6d4c4a29fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:36.653506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 650/1307] 10.222.0.42 () {58 vars in 1039 bytes} [Tue Oct 12 16:46:36 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:36.663451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c701dd7-91a1-4c38-a7ef-57bdf728fc32 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:36.677828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c701dd7-91a1-4c38-a7ef-57bdf728fc32 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:36.682818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:36.683460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:36.683742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:36.684015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:36.691826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:36.693960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292452b-ac2d-402d-888b-f2d8c01a7a34 service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:36.701741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 658/1308] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:46:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:46:37.527111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b4a-8aa0-43b1-b2dc-b89d61b937d2 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:37.528049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b4a-8aa0-43b1-b2dc-b89d61b937d2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:37.528600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c8b4a-8aa0-43b1-b2dc-b89d61b937d2 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:37.535079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 651/1309] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:37.537316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c079d-46dd-4ba0-a5dc-6f8c7aa22932 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:37.537768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c079d-46dd-4ba0-a5dc-6f8c7aa22932 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:37.537999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c079d-46dd-4ba0-a5dc-6f8c7aa22932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:37.556789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0f0c079d-46dd-4ba0-a5dc-6f8c7aa22932 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:37.558164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0f0c079d-46dd-4ba0-a5dc-6f8c7aa22932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:37.569209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 659/1310] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:37.617236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c8b4a-8aa0-43b1-b2dc-b89d61b937d2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:37.635047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c8b4a-8aa0-43b1-b2dc-b89d61b937d2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:37.640452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:37.642880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:37.642880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:37.642880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:37.651167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:37.652754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023bdb1-610d-4569-bc12-d237278a42c3 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:37.662542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 652/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:53.914248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928444-7c9c-4ee4-89df-c0b96086db6f None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:53.914818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928444-7c9c-4ee4-89df-c0b96086db6f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:53.914818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928444-7c9c-4ee4-89df-c0b96086db6f None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:53.916552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 660/1312] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:53.922482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5c11-02d6-4375-8fa9-8d6c654dc732 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:53.922957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5c11-02d6-4375-8fa9-8d6c654dc732 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:53.923064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd5c11-02d6-4375-8fa9-8d6c654dc732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:53.940649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-75cd5c11-02d6-4375-8fa9-8d6c654dc732 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:53.941851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-75cd5c11-02d6-4375-8fa9-8d6c654dc732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:53.949561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 653/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:53.973070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928444-7c9c-4ee4-89df-c0b96086db6f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:53.985990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928444-7c9c-4ee4-89df-c0b96086db6f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:53.991570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:53.992209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:53.992493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:53.992769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:53.993580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:53.995454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d5763-9c05-4039-b105-45a7887d14c6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:54.009007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 661/1314] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:46:53 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:46:56.212295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2135b-e205-4c59-bde1-e5e0afc3289b None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:56.212875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2135b-e205-4c59-bde1-e5e0afc3289b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:56.212875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2135b-e205-4c59-bde1-e5e0afc3289b None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:56.214647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 654/1315] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:56.220895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:56.221395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:56.221576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:56.240116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:56.241590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:56.251427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 662/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:56.276227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2135b-e205-4c59-bde1-e5e0afc3289b None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:56.288244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2135b-e205-4c59-bde1-e5e0afc3289b None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:56.292599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:56.293472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:56.293745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:56.294015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] PATH_INFO: `/v3/projects/20e5d8309d0d4c479df70ac4253c7217` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:56.304831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=20e5d8309d0d4c479df70ac4253c7217)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:56.307544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:56.310853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 655/1317] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:46:56 2021] GET /identity/v3/projects/20e5d8309d0d4c479df70ac4253c7217 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:56.318331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:56.327665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b2e2-1932-4c0e-84f1-5c9393227c32 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:56.332303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:56.333670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:56.333951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:56.334223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:56.335008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] RBAC: Adding query filter params (scope.project.id=20e5d8309d0d4c479df70ac4253c7217) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:46:56.335309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:56.337187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3638f-1f25-4ad0-853a-6e6b0c4f356e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:56.344166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 663/1318] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:46:56 2021] GET /identity/v3/role_assignments?scope.project.id=20e5d8309d0d4c479df70ac4253c7217 => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:56.350669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:56.360288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2a32-aea4-41e5-9157-7043d469dbc1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:56.365321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:56.366166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:56.366443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:56.366716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] PATH_INFO: `/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:56.380974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] RBAC: Authorizing `identity:get_user(user_id=f6817b1dadd544c5ab6ff9a99f1eb494)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:56.383125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e1be7-e997-45d9-be4c-64da88090403 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:56.384793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 656/1319] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:46:56 2021] GET /identity/v3/users/f6817b1dadd544c5ab6ff9a99f1eb494 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:58.675894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54ba7-5ee5-412a-94a1-7e05c16caee7 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.676464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54ba7-5ee5-412a-94a1-7e05c16caee7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.676464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54ba7-5ee5-412a-94a1-7e05c16caee7 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.678741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 664/1320] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:46:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:58.684688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.685101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.685280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.702935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:58.704131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:58.711932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 657/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:46:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:58.735586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54ba7-5ee5-412a-94a1-7e05c16caee7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:58.748285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54ba7-5ee5-412a-94a1-7e05c16caee7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:58.753212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:58.754042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.754326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.754601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] PATH_INFO: `/v3/projects/557e8120af564b7e89ab21eedf471cba` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.766183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] RBAC: Authorizing `identity:get_project(project_id=557e8120af564b7e89ab21eedf471cba)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:58.768281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:58.770048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 665/1322] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:46:58 2021] GET /identity/v3/projects/557e8120af564b7e89ab21eedf471cba => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:58.776596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:58.785533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3f28-fc9b-4220-9b49-8dbc93019693 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:58.790090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:58.790722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.791004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.791275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.792042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] RBAC: Adding query filter params (scope.project.id=557e8120af564b7e89ab21eedf471cba) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:46:58.792351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:58.794212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:58.801203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 658/1323] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:46:58 2021] GET /identity/v3/role_assignments?scope.project.id=557e8120af564b7e89ab21eedf471cba => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:58.807754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:58.817927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa18f-6a7b-44c8-a79b-6faf281530da admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:58.822464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:58.823305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.823587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.823859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] PATH_INFO: `/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.836708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] RBAC: Authorizing `identity:get_user(user_id=2ac72111bf8c4ec193a5b7b2b1f3404f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:58.838938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b63c3-a187-4bf1-b2d9-faff57edd3db admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:58.840549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 666/1324] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:46:58 2021] GET /identity/v3/users/2ac72111bf8c4ec193a5b7b2b1f3404f => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:58.846709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:58.856329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11aa2e-7c79-45ec-8e61-f22a17d2a537 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:58.860818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:58.861715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:58.861988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:58.862255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] PATH_INFO: `/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:58.875612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5d5cd4df19ce4be8b320b8c3dc726ebd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:58.878038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5757e8-8626-4168-876e-39bb72a6b4a1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:58.879655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 659/1325] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:46:58 2021] GET /identity/v3/users/5d5cd4df19ce4be8b320b8c3dc726ebd => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:01.242555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926749-da0c-427c-a234-e6da1f76707b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.243184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926749-da0c-427c-a234-e6da1f76707b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.243184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926749-da0c-427c-a234-e6da1f76707b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.244917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 667/1326] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:01.250806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.251243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.251333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.268657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:01.269860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:01.277528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 660/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:01.301224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13926749-da0c-427c-a234-e6da1f76707b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:01.314238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13926749-da0c-427c-a234-e6da1f76707b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:01.318650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:01.319536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.319812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.320082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] PATH_INFO: `/v3/projects/8e37e35b6f6c4f5ab54655361435da7d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.330306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] RBAC: Authorizing `identity:get_project(project_id=8e37e35b6f6c4f5ab54655361435da7d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:01.332342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:01.334048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 668/1328] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:47:01 2021] GET /identity/v3/projects/8e37e35b6f6c4f5ab54655361435da7d => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:01.340701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:01.350163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d77778-cf93-4e3b-8544-5f289adfd0ec None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:01.354864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:01.355497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.355778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.356053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.356832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] RBAC: Adding query filter params (scope.project.id=8e37e35b6f6c4f5ab54655361435da7d) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:47:01.357183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:01.359019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:01.366223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 661/1329] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:47:01 2021] GET /identity/v3/role_assignments?scope.project.id=8e37e35b6f6c4f5ab54655361435da7d => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:47:01.372488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:01.382332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f64df-1dde-4ada-a250-c301c111786a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:01.386829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:01.387663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.388000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.388200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.389417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:01.391227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635873-a3a2-4679-9030-3c14eba9c36b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:01.392784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 669/1330] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:01 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:47:01.399217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:01.408586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337610c4-f288-4f40-bb41-6606c9779329 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:01.413886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:01.416342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:01.416342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:01.416342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:01.429887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:01.432038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba8019-6906-4a51-b7c9-77c86003c5fe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:01.433783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 662/1331] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:01 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:47:03.798160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284feb4-7e11-4916-a37c-924a58357c56 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:03.798731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284feb4-7e11-4916-a37c-924a58357c56 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:03.798731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284feb4-7e11-4916-a37c-924a58357c56 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:03.800478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 670/1332] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:03.806883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:03.807334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:03.807455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:03.824790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:03.826079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:03.834302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 663/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:03.858115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284feb4-7e11-4916-a37c-924a58357c56 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:03.870761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284feb4-7e11-4916-a37c-924a58357c56 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:03.875370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:03.876204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:03.876489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:03.876767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] PATH_INFO: `/v3/projects/b61275effdf24482bcc1bd65402937f8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:03.888292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] RBAC: Authorizing `identity:get_project(project_id=b61275effdf24482bcc1bd65402937f8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:03.890377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:03.892047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 671/1334] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:47:03 2021] GET /identity/v3/projects/b61275effdf24482bcc1bd65402937f8 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:03.898793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:03.907726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4e0b7-2801-4ff0-91c6-2e8f1d197528 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:03.912260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:03.912887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:03.913196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:03.913472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:03.914239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] RBAC: Adding query filter params (scope.project.id=b61275effdf24482bcc1bd65402937f8) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:47:03.914544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:03.916356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8531df4-0f55-4397-9e38-cd54be54c462 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:03.921681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 664/1335] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:47:03 2021] GET /identity/v3/role_assignments?scope.project.id=b61275effdf24482bcc1bd65402937f8 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:03.928292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:03.937939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251143e-a342-4a6f-b238-fd86bcfe8afa admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:03.943157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:03.943991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:03.944272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:03.944546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] PATH_INFO: `/v3/users/30442ae5eaf142eb87cd0beca5fcea8a` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:03.957556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] RBAC: Authorizing `identity:get_user(user_id=30442ae5eaf142eb87cd0beca5fcea8a)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:03.959680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb580f74-1c78-43da-8b03-a1ddb49ef20f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:03.961333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 672/1336] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:03 2021] GET /identity/v3/users/30442ae5eaf142eb87cd0beca5fcea8a => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:06.236537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16474f-75fa-4e51-889c-a8fd4a883fe3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.237090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16474f-75fa-4e51-889c-a8fd4a883fe3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.237215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16474f-75fa-4e51-889c-a8fd4a883fe3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.239408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 665/1337] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:06.245471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.245854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.246029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.264357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:06.265558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:06.273289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 673/1338] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:06.296984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16474f-75fa-4e51-889c-a8fd4a883fe3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:06.310207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16474f-75fa-4e51-889c-a8fd4a883fe3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:06.314614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:06.315454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.315736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.316012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] PATH_INFO: `/v3/projects/d4975348f1bb42b791ce15f4573297db` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.327585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4975348f1bb42b791ce15f4573297db)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:06.329693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:06.331392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 666/1339] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:47:06 2021] GET /identity/v3/projects/d4975348f1bb42b791ce15f4573297db => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:06.338087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:06.346998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0455-f362-4264-97e0-7ba78f728dc4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:06.351709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:06.352331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.352608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.352878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.353775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] RBAC: Adding query filter params (scope.project.id=d4975348f1bb42b791ce15f4573297db) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:47:06.354075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:06.355900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:06.362411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 674/1340] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:47:06 2021] GET /identity/v3/role_assignments?scope.project.id=d4975348f1bb42b791ce15f4573297db => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:47:06.369350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:06.379107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff45a-26b7-42ca-9168-b03e2c8dfa34 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:06.384210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:06.385095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.385376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.385650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.386832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:06.388648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a1f3b-29c5-4342-aaef-31346a07867c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:06.390265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 667/1341] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:06 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:47:06.396228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:06.405973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880e4ec-9e69-4440-a703-d286a1018dce admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:06.410587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:06.411440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:06.411723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:06.411999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] PATH_INFO: `/v3/users/ffd3b131dc274730b842a360dce35cfb` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:06.425542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=ffd3b131dc274730b842a360dce35cfb)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:06.428194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e579421-ac63-4758-a59d-22f9ecf302c6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:06.429946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 675/1342] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:06 2021] GET /identity/v3/users/ffd3b131dc274730b842a360dce35cfb => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:08.764383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83648f23-a82e-4efa-afda-9d918dc157cb None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:08.765003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83648f23-a82e-4efa-afda-9d918dc157cb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:08.765003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83648f23-a82e-4efa-afda-9d918dc157cb None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:08.766746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 668/1343] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:08.775672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:08.776195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:08.776341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:08.793404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:08.794598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:08.803054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 676/1344] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:47:08.827477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83648f23-a82e-4efa-afda-9d918dc157cb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:08.840328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83648f23-a82e-4efa-afda-9d918dc157cb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:08.844682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:08.845546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:08.845820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:08.846086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] PATH_INFO: `/v3/projects/db98b0858f614767988c57728bae50ba` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:08.856255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] RBAC: Authorizing `identity:get_project(project_id=db98b0858f614767988c57728bae50ba)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:08.858344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:08.860016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 669/1345] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:47:08 2021] GET /identity/v3/projects/db98b0858f614767988c57728bae50ba => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:08.866541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:08.875615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a33945-0f31-46ab-95e4-4d82228c01d2 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:08.880854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:08.881592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:08.881875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:08.882151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:08.882921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] RBAC: Adding query filter params (scope.project.id=db98b0858f614767988c57728bae50ba) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:47:08.883226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:08.885098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753991df-90e2-4013-93e4-00cae963e4d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:08.890367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 677/1346] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:47:08 2021] GET /identity/v3/role_assignments?scope.project.id=db98b0858f614767988c57728bae50ba => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:08.896977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:08.906514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809de8a-063f-4454-86f9-267f6c4d21ce admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:08.911142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:08.911985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:08.912268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:08.912543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] PATH_INFO: `/v3/users/28c4a9e1cf09468db7274b5d516b04b1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:08.913773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] RBAC: Authorizing `identity:get_user(user_id=28c4a9e1cf09468db7274b5d516b04b1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:08.915879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2275c-86d7-4ed7-aba7-aac7483627fe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:08.917486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 670/1347] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:08 2021] GET /identity/v3/users/28c4a9e1cf09468db7274b5d516b04b1 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:11.165452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cbcbe-e89c-4908-8a63-c18f9b66ab1b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:11.165998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cbcbe-e89c-4908-8a63-c18f9b66ab1b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:11.165998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cbcbe-e89c-4908-8a63-c18f9b66ab1b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:11.168105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 678/1348] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:11.174121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:11.174557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:11.174652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:11.193525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:11.194714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:11.202448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 671/1349] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:47:11.226638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cbcbe-e89c-4908-8a63-c18f9b66ab1b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:11.239423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cbcbe-e89c-4908-8a63-c18f9b66ab1b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:11.243942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:11.244783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:11.245099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:11.245378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] PATH_INFO: `/v3/projects/f0ea88d5877948298aefb26cf4ba2957` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:11.246591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0ea88d5877948298aefb26cf4ba2957)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:11.248368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:11.250325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 679/1350] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Oct 12 16:47:11 2021] GET /identity/v3/projects/f0ea88d5877948298aefb26cf4ba2957 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:47:11.257778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:11.267013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f905-2c3d-4a32-a63c-92aaaf172a20 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:11.272389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:11.273062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:11.273343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:11.273737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:11.274512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] RBAC: Adding query filter params (scope.project.id=f0ea88d5877948298aefb26cf4ba2957) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:47:11.274818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:11.276657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06a98-7fa1-43d8-b1b0-89165e24e16c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:11.282466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 672/1351] 10.222.0.42 () {56 vars in 1231 bytes} [Tue Oct 12 16:47:11 2021] GET /identity/v3/role_assignments?scope.project.id=f0ea88d5877948298aefb26cf4ba2957 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:11.288698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:11.298353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd36a4-0081-4c33-9298-e1d0335e05e2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:11.302949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:11.303800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:11.304087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:11.304365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] PATH_INFO: `/v3/users/12c2b7d3088e4259a65e864f8c35d8fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:11.305599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c2b7d3088e4259a65e864f8c35d8fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:11.307390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672b1e5-5f57-45f9-b161-f6805cb588d3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:11.309045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 680/1352] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Oct 12 16:47:11 2021] GET /identity/v3/users/12c2b7d3088e4259a65e864f8c35d8fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:47:16.511171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc329-1241-4be8-985f-26dcf32b2f3f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:16.511699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc329-1241-4be8-985f-26dcf32b2f3f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:16.511699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc329-1241-4be8-985f-26dcf32b2f3f None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:16.513564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 673/1353] 10.222.0.42 () {54 vars in 918 bytes} [Tue Oct 12 16:47:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:16.519431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817847-e3d6-4158-a731-42fcd57400d1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:16.519894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817847-e3d6-4158-a731-42fcd57400d1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:16.520603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817847-e3d6-4158-a731-42fcd57400d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:16.538391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6e817847-e3d6-4158-a731-42fcd57400d1 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:16.539571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6e817847-e3d6-4158-a731-42fcd57400d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:16.548208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 681/1354] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 12 16:47:16 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:16.563272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516576c-9032-42ee-85e9-8ed0ae9aaf3e None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:16.563496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516576c-9032-42ee-85e9-8ed0ae9aaf3e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:16.563770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516576c-9032-42ee-85e9-8ed0ae9aaf3e None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:16.565556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 674/1355] 10.222.0.42 () {54 vars in 918 bytes} [Tue Oct 12 16:47:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:47:16.571364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928357-49ff-489c-8dbe-2f2205fe9f50 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:16.571654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928357-49ff-489c-8dbe-2f2205fe9f50 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:16.571929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13928357-49ff-489c-8dbe-2f2205fe9f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:16.589905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-13928357-49ff-489c-8dbe-2f2205fe9f50 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:16.591083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-13928357-49ff-489c-8dbe-2f2205fe9f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:16.600806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 682/1356] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Oct 12 16:47:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:19.479029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0fc-812e-4849-8f63-f67465d2920a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:19.479590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0fc-812e-4849-8f63-f67465d2920a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:19.479590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0fc-812e-4849-8f63-f67465d2920a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:19.481400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 675/1357] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:19.487389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8186d0c-3b3b-4bf6-8f7f-2ae3fede754c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:19.487790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8186d0c-3b3b-4bf6-8f7f-2ae3fede754c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:19.487949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8186d0c-3b3b-4bf6-8f7f-2ae3fede754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:19.506222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d8186d0c-3b3b-4bf6-8f7f-2ae3fede754c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:19.507393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d8186d0c-3b3b-4bf6-8f7f-2ae3fede754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:19.515104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 683/1358] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:19.559800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f0fc-812e-4849-8f63-f67465d2920a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:19.573840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f0fc-812e-4849-8f63-f67465d2920a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:19.579189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:19.579833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:19.580116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:19.580389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:19.588792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:19.590386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fbea5-af9c-4b9f-bf01-6db8eca91d44 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:19.600047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 676/1359] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:21.073600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e13c-fed9-4772-a59a-06716bf331d4 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:21.074126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e13c-fed9-4772-a59a-06716bf331d4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:21.074126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314e13c-fed9-4772-a59a-06716bf331d4 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:21.075846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 684/1360] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:21.081232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b48f-660c-4322-8fa9-f183a4bfd46b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:21.081663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b48f-660c-4322-8fa9-f183a4bfd46b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:21.081769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b48f-660c-4322-8fa9-f183a4bfd46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:21.099467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0315b48f-660c-4322-8fa9-f183a4bfd46b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:21.100639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0315b48f-660c-4322-8fa9-f183a4bfd46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:21.108202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 677/1361] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:21.262092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314e13c-fed9-4772-a59a-06716bf331d4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:21.282098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314e13c-fed9-4772-a59a-06716bf331d4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:21.288131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:21.288763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:21.289069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:21.289348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:21.297415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:21.299033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5355d-cec7-44a1-a740-b055e80a7630 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:21.308289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 685/1362] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:22.773733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c672ed2-b3c8-499e-b4ef-fa8d5ffb2187 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.774284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c672ed2-b3c8-499e-b4ef-fa8d5ffb2187 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.774284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c672ed2-b3c8-499e-b4ef-fa8d5ffb2187 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.776043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 678/1363] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:22.781509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3f55-1b28-4204-8284-264c17432d59 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.781967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3f55-1b28-4204-8284-264c17432d59 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.782063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3f55-1b28-4204-8284-264c17432d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.799304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-07bc3f55-1b28-4204-8284-264c17432d59 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:22.800491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-07bc3f55-1b28-4204-8284-264c17432d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:22.808712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 686/1364] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:22.960912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c672ed2-b3c8-499e-b4ef-fa8d5ffb2187 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:22.975500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c672ed2-b3c8-499e-b4ef-fa8d5ffb2187 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:22.980869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:22.981523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:22.981804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:22.982076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:22.990952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:22.992517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70ee91-0ff9-499e-b657-70d06daaaa41 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:23.001647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 679/1365] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:24.429811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1fc0-98cb-49aa-a8f2-89f49811a6dd None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.430364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1fc0-98cb-49aa-a8f2-89f49811a6dd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.430364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1fc0-98cb-49aa-a8f2-89f49811a6dd None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.432148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 687/1366] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:24.438684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef1ad-a68f-4b4f-a0dc-881b19ac4add None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.439158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef1ad-a68f-4b4f-a0dc-881b19ac4add None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.439359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef1ad-a68f-4b4f-a0dc-881b19ac4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.460019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-afaef1ad-a68f-4b4f-a0dc-881b19ac4add None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:24.461232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-afaef1ad-a68f-4b4f-a0dc-881b19ac4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:24.468909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 680/1367] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:24.621775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1fc0-98cb-49aa-a8f2-89f49811a6dd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:24.636000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1fc0-98cb-49aa-a8f2-89f49811a6dd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:24.641383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:24.642012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:24.642298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:24.642573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:24.650493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:24.652099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a5a90-b491-4ac6-a832-ebd0564316b2 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:24.663558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 688/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:26.104590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28eb9-8332-4c8f-8cd8-e850304a1b4a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:26.105200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28eb9-8332-4c8f-8cd8-e850304a1b4a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:26.105317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28eb9-8332-4c8f-8cd8-e850304a1b4a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:26.107102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 681/1369] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:26.113148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd8be-577e-42d3-a59e-e2061cfe0333 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:26.113708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd8be-577e-42d3-a59e-e2061cfe0333 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:26.113708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bd8be-577e-42d3-a59e-e2061cfe0333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:26.132771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bb7bd8be-577e-42d3-a59e-e2061cfe0333 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:26.133973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bb7bd8be-577e-42d3-a59e-e2061cfe0333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:26.141952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 689/1370] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:26.296425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce28eb9-8332-4c8f-8cd8-e850304a1b4a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:26.314732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce28eb9-8332-4c8f-8cd8-e850304a1b4a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:26.320681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:26.321356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:26.321633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:26.321919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:26.331077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:26.333441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5e97-a755-4b91-afe3-7cf800923bb4 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:26.343181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 682/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:27.745146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f872ab-7e0d-4a3c-b8aa-442249155035 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:27.745706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f872ab-7e0d-4a3c-b8aa-442249155035 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:27.745706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f872ab-7e0d-4a3c-b8aa-442249155035 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:27.747508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 690/1372] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:27.753320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c048-15be-4d0c-90c8-409c9af00448 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:27.753758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c048-15be-4d0c-90c8-409c9af00448 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:27.753861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c048-15be-4d0c-90c8-409c9af00448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:27.771319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9be3c048-15be-4d0c-90c8-409c9af00448 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:27.772495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9be3c048-15be-4d0c-90c8-409c9af00448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:27.780180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 683/1373] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:27.933028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f872ab-7e0d-4a3c-b8aa-442249155035 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:27.947196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f872ab-7e0d-4a3c-b8aa-442249155035 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:27.953047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:27.953670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:27.953975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:27.954245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:27.962765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:27.964364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f48aa-86d5-4b76-a3d6-4153e5513df8 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:27.973940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 691/1374] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:29.399790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713363-3657-4bb1-8efb-ec1739c736a0 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:29.400305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713363-3657-4bb1-8efb-ec1739c736a0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:29.400388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713363-3657-4bb1-8efb-ec1739c736a0 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:29.402162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 684/1375] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:29.407762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235e54-4e08-4698-bd80-a71e393db6b4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:29.408171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235e54-4e08-4698-bd80-a71e393db6b4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:29.408316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4235e54-4e08-4698-bd80-a71e393db6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:29.426581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b4235e54-4e08-4698-bd80-a71e393db6b4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:29.427790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b4235e54-4e08-4698-bd80-a71e393db6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:29.435952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 692/1376] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:29.589644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de713363-3657-4bb1-8efb-ec1739c736a0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:29.604416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de713363-3657-4bb1-8efb-ec1739c736a0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:29.609891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:29.610518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:29.610800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:29.611073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:29.619311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:29.620895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd5b9b-42b1-4b8b-a864-05177124dc73 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:29.630624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 685/1377] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:31.011850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42455-3d2b-4922-aab3-d7fb84c2ab90 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:31.012407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42455-3d2b-4922-aab3-d7fb84c2ab90 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:31.012407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e42455-3d2b-4922-aab3-d7fb84c2ab90 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:31.014236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 693/1378] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:31.019703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d428-bb67-421f-b3a7-b3c6c3ca817f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:31.020110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d428-bb67-421f-b3a7-b3c6c3ca817f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:31.020247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d428-bb67-421f-b3a7-b3c6c3ca817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:31.038485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b785d428-bb67-421f-b3a7-b3c6c3ca817f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:31.039626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b785d428-bb67-421f-b3a7-b3c6c3ca817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:31.047703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 686/1379] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:31.203213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e42455-3d2b-4922-aab3-d7fb84c2ab90 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:31.217297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e42455-3d2b-4922-aab3-d7fb84c2ab90 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:31.223166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:31.223789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:31.224074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:31.224353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:31.232390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:31.234021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b035-f667-41fe-8538-4dfe4f85a1cf service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:31.243825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 694/1380] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:32.619342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddef19-ad57-4b3b-9ac4-823d73ac9462 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:32.619867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddef19-ad57-4b3b-9ac4-823d73ac9462 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:32.619867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddef19-ad57-4b3b-9ac4-823d73ac9462 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:32.621673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 687/1381] 10.222.0.42 () {54 vars in 911 bytes} [Tue Oct 12 16:47:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:32.627578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c960a-7856-4638-817e-25521c6176a9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:32.628013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c960a-7856-4638-817e-25521c6176a9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:32.628111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c960a-7856-4638-817e-25521c6176a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:32.646617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-339c960a-7856-4638-817e-25521c6176a9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:32.647774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-339c960a-7856-4638-817e-25521c6176a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:32.655350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 695/1382] 10.222.0.42 () {58 vars in 1008 bytes} [Tue Oct 12 16:47:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:32.807248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddef19-ad57-4b3b-9ac4-823d73ac9462 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:32.822011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddef19-ad57-4b3b-9ac4-823d73ac9462 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:32.827586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:32.828246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:32.828524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:32.828800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:32.837567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:32.839128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bb885-01f9-4563-9be0-4968d4cf1056 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:32.848549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 688/1383] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:35.070167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa150-ab61-4428-b007-17a958fcf2e6 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:35.070765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa150-ab61-4428-b007-17a958fcf2e6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:35.070765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa150-ab61-4428-b007-17a958fcf2e6 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:35.072545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 696/1384] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:35.079049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44b16-8730-43b1-b574-3803bba526da None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:35.079482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44b16-8730-43b1-b574-3803bba526da None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:35.079589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44b16-8730-43b1-b574-3803bba526da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:35.098012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-60a44b16-8730-43b1-b574-3803bba526da None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:35.099265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-60a44b16-8730-43b1-b574-3803bba526da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:35.106967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 689/1385] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:35.147406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa150-ab61-4428-b007-17a958fcf2e6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:35.157938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa150-ab61-4428-b007-17a958fcf2e6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:35.161935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:35.162550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:35.162825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:35.163093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:35.171640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:35.173127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dd194-c823-4ffd-93c9-fd10583fb50a service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:35.182816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 697/1386] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:37.592404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9207-fd25-44b4-84b1-3cfbdbc066c3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.592935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9207-fd25-44b4-84b1-3cfbdbc066c3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.592935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9207-fd25-44b4-84b1-3cfbdbc066c3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.594682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 690/1387] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:37.601350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4d6a-118a-4431-a27e-34be0bde611a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.601735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4d6a-118a-4431-a27e-34be0bde611a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.601896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4d6a-118a-4431-a27e-34be0bde611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.619294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cf3b4d6a-118a-4431-a27e-34be0bde611a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:37.620494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cf3b4d6a-118a-4431-a27e-34be0bde611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:37.629097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 698/1388] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:37.669021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9207-fd25-44b4-84b1-3cfbdbc066c3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:37.679453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9207-fd25-44b4-84b1-3cfbdbc066c3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:37.683081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:37.683729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:37.683962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:37.684233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:37.692823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:37.694279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb771f-3b6a-4e2f-89c0-94dfc03483c4 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:37.703264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 691/1389] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:40.256863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9fc7-98a0-4c1d-8357-551aa13aaa36 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:40.257491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9fc7-98a0-4c1d-8357-551aa13aaa36 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:40.257607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f9fc7-98a0-4c1d-8357-551aa13aaa36 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:40.259502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 699/1390] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:40.265647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1fb8-4837-4b92-b720-e702e6ffb83f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:40.266142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1fb8-4837-4b92-b720-e702e6ffb83f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:40.266240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1fb8-4837-4b92-b720-e702e6ffb83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:40.285307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c50a1fb8-4837-4b92-b720-e702e6ffb83f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:40.286499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c50a1fb8-4837-4b92-b720-e702e6ffb83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:40.294402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 692/1391] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:40.335137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f9fc7-98a0-4c1d-8357-551aa13aaa36 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:40.345769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f9fc7-98a0-4c1d-8357-551aa13aaa36 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:40.349458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:40.350091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:40.350375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:40.350652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:40.359750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:40.361176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd350c7-da6a-4166-83ab-45544fd0b4e4 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:40.370366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 700/1392] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:42.746493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ca64-0eb0-42e0-9777-fcb2ef520f97 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.747084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ca64-0eb0-42e0-9777-fcb2ef520f97 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.747084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4ca64-0eb0-42e0-9777-fcb2ef520f97 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.748785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 693/1393] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:42.755393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90093-fa1d-4811-82ab-3377b5fa2792 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.755828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90093-fa1d-4811-82ab-3377b5fa2792 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.756066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90093-fa1d-4811-82ab-3377b5fa2792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.773723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-53b90093-fa1d-4811-82ab-3377b5fa2792 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:42.774891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-53b90093-fa1d-4811-82ab-3377b5fa2792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:42.782429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 701/1394] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:42.821684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4ca64-0eb0-42e0-9777-fcb2ef520f97 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:42.833252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4ca64-0eb0-42e0-9777-fcb2ef520f97 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:42.836764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:42.837429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:42.837712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:42.837984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:42.846899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:42.848316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0fe7-ef76-4847-82de-999b5a4a71ce service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:42.857492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 694/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:45.128760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a639ea-4abc-4bb3-976f-d858f23f73e1 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:45.129339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a639ea-4abc-4bb3-976f-d858f23f73e1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:45.129339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a639ea-4abc-4bb3-976f-d858f23f73e1 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:45.131730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 702/1396] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:45.137642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4856a6-01c7-4f2a-b54d-a3b5d9317905 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:45.138106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4856a6-01c7-4f2a-b54d-a3b5d9317905 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:45.138208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4856a6-01c7-4f2a-b54d-a3b5d9317905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:45.155502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7d4856a6-01c7-4f2a-b54d-a3b5d9317905 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:45.156682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7d4856a6-01c7-4f2a-b54d-a3b5d9317905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:45.165152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 695/1397] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:45.206226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a639ea-4abc-4bb3-976f-d858f23f73e1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:45.216852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a639ea-4abc-4bb3-976f-d858f23f73e1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:45.220367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:45.221052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:45.221339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:45.221547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:45.230278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:45.231757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd65a2-d9c3-4289-9f29-5d665784fb5b service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:45.241802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 703/1398] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:47.536493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7702-5e36-4c3a-9b5c-b006eda16fef None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:47.537175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7702-5e36-4c3a-9b5c-b006eda16fef None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:47.537175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7702-5e36-4c3a-9b5c-b006eda16fef None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:47.538820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 696/1399] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:47.544658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00910b-fe97-474d-85f4-af3cf9c644b7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:47.545083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00910b-fe97-474d-85f4-af3cf9c644b7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:47.545266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00910b-fe97-474d-85f4-af3cf9c644b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:47.563305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-dc00910b-fe97-474d-85f4-af3cf9c644b7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:47.564425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dc00910b-fe97-474d-85f4-af3cf9c644b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:47.572851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 704/1400] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:47.611154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca7702-5e36-4c3a-9b5c-b006eda16fef None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:47.622383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca7702-5e36-4c3a-9b5c-b006eda16fef None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:47.625949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:47.626571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:47.626871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:47.627494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:47.636890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:47.638370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec308c-2977-4ba3-a2f9-eeb55bdd09b9 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:47.647423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 697/1401] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:49.949700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9054b8-ba8b-4143-8c24-23c7f5566631 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:49.950247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9054b8-ba8b-4143-8c24-23c7f5566631 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:49.950365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9054b8-ba8b-4143-8c24-23c7f5566631 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:49.952085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 705/1402] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:49.958223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb6b4-595b-4f3f-bea6-a2a912665ac8 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:49.958650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb6b4-595b-4f3f-bea6-a2a912665ac8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:49.958755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb6b4-595b-4f3f-bea6-a2a912665ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:49.976481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-bf9cb6b4-595b-4f3f-bea6-a2a912665ac8 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:49.977696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-bf9cb6b4-595b-4f3f-bea6-a2a912665ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:49.985326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 698/1403] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:50.024337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9054b8-ba8b-4143-8c24-23c7f5566631 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:50.035275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9054b8-ba8b-4143-8c24-23c7f5566631 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:50.038843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:50.039461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:50.039738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:50.040007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:50.048605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:50.050631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2935-4c0e-4dbc-b516-0db3c3816f0d service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:50.059672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 706/1404] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:52.345599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495574-02ad-4472-a305-e43f8a97d631 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:52.346119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495574-02ad-4472-a305-e43f8a97d631 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:52.346119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495574-02ad-4472-a305-e43f8a97d631 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:52.348388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 699/1405] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:52.354300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5235cf2-1541-4a86-8dfc-52af01273215 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:52.354765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5235cf2-1541-4a86-8dfc-52af01273215 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:52.354887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5235cf2-1541-4a86-8dfc-52af01273215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:52.372701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b5235cf2-1541-4a86-8dfc-52af01273215 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:52.373955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b5235cf2-1541-4a86-8dfc-52af01273215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:52.381816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 707/1406] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:52.420968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c495574-02ad-4472-a305-e43f8a97d631 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:52.431993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c495574-02ad-4472-a305-e43f8a97d631 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:52.435553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:52.436177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:52.436528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:52.436718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:52.445298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:52.447239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972957c4-6e00-47dc-9e11-95427736f6e2 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:52.462466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 700/1407] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:54.720525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:54.721138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:54.721138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:54.723458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 708/1408] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:54.729991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26f3a-b6b4-4f59-8baa-193fb27f001c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:54.730519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26f3a-b6b4-4f59-8baa-193fb27f001c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:54.730662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26f3a-b6b4-4f59-8baa-193fb27f001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:54.749625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-4ec26f3a-b6b4-4f59-8baa-193fb27f001c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:54.750831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4ec26f3a-b6b4-4f59-8baa-193fb27f001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:54.758862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 701/1409] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:54.796683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:54.798378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:54.811539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc25f72-9a80-4ef3-bd32-916e1344bcd3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:54.815101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:54.815711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:54.815994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:54.816269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:54.825217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:54.826597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839955-4375-4783-8480-8b95a25be621 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:54.836209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 709/1410] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:47:57.177602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c51e9-14a1-493b-bb78-c893ddff2cef None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:57.178232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c51e9-14a1-493b-bb78-c893ddff2cef None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:57.178232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c51e9-14a1-493b-bb78-c893ddff2cef None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:57.179903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 702/1411] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:47:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:47:57.185846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf964-8e0e-484a-bd40-697e156b739a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:57.186300 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf964-8e0e-484a-bd40-697e156b739a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:57.186394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaf964-8e0e-484a-bd40-697e156b739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:57.203990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-7ceaf964-8e0e-484a-bd40-697e156b739a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:47:57.205204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7ceaf964-8e0e-484a-bd40-697e156b739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:47:57.213613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 710/1412] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:47:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:47:57.251783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c51e9-14a1-493b-bb78-c893ddff2cef None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:47:57.262482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c51e9-14a1-493b-bb78-c893ddff2cef None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:47:57.267786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:47:57.268965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:47:57.269264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:47:57.269534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:47:57.278543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:47:57.279950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cd15d-e687-4862-8bd2-f5693fad8c01 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:47:57.289566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 703/1413] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:47:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:14.087833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c282-b713-4f35-8cc8-b276fcfa0465 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.088460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c282-b713-4f35-8cc8-b276fcfa0465 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.088460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c282-b713-4f35-8cc8-b276fcfa0465 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.090224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 711/1414] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:14.096762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e48e-5daf-4af8-9f5e-7f257e342819 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.097256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e48e-5daf-4af8-9f5e-7f257e342819 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.097361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e48e-5daf-4af8-9f5e-7f257e342819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.115032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-af06e48e-5daf-4af8-9f5e-7f257e342819 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:14.116196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-af06e48e-5daf-4af8-9f5e-7f257e342819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.123758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 704/1415] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:14.176352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137abde-20ed-4669-90a6-a8b94957d4d8 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.176686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137abde-20ed-4669-90a6-a8b94957d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.176962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137abde-20ed-4669-90a6-a8b94957d4d8 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.178786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 712/1416] 10.222.0.42 () {54 vars in 961 bytes} [Tue Oct 12 16:48:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:14.184065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2065-f723-4a0e-acd7-ee13beab0f47 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.184349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2065-f723-4a0e-acd7-ee13beab0f47 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.184622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2065-f723-4a0e-acd7-ee13beab0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.202178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0d3f2065-f723-4a0e-acd7-ee13beab0f47 None None] MFA Rules not processed for user `e5854e1cb2f34a049f72909a002dde73`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:14.203337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0d3f2065-f723-4a0e-acd7-ee13beab0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.209611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 705/1417] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Oct 12 16:48:14 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:14.217349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137abde-20ed-4669-90a6-a8b94957d4d8 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:14.228283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137abde-20ed-4669-90a6-a8b94957d4d8 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:14.231840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:14.232462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.232741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.233054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.242305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:14.243730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6749-3daa-42cc-90e1-be76a645fefd service glance] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:14.253052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 713/1418] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:16.666459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05b06-cc39-4531-b865-ae8764b2ae96 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.666983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05b06-cc39-4531-b865-ae8764b2ae96 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.666983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05b06-cc39-4531-b865-ae8764b2ae96 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.668685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 706/1419] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:16.677163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a34e-4d29-4696-a11f-a65d7ba3d78e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.677558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a34e-4d29-4696-a11f-a65d7ba3d78e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.677717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3a34e-4d29-4696-a11f-a65d7ba3d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.695619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-25a3a34e-4d29-4696-a11f-a65d7ba3d78e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:16.696815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-25a3a34e-4d29-4696-a11f-a65d7ba3d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.704892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 714/1420] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:16.729901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05b06-cc39-4531-b865-ae8764b2ae96 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.744193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05b06-cc39-4531-b865-ae8764b2ae96 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.748634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.749316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.749598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.749873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.750612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.753373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c85c-dfdb-458d-953b-57d5ce62bf77 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.772520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 707/1421] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Oct 12 16:48:16 2021] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:19.057538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffca85-e394-4167-ac7e-2435a5d5154d None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.058120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffca85-e394-4167-ac7e-2435a5d5154d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.058120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffca85-e394-4167-ac7e-2435a5d5154d None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.059920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 715/1422] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:19.066470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33760856-24e5-491f-a822-5652dad801a4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.066872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33760856-24e5-491f-a822-5652dad801a4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.067021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33760856-24e5-491f-a822-5652dad801a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.084654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-33760856-24e5-491f-a822-5652dad801a4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:19.085934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-33760856-24e5-491f-a822-5652dad801a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.094504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 708/1423] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:19.140677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffca85-e394-4167-ac7e-2435a5d5154d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.154710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffca85-e394-4167-ac7e-2435a5d5154d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:19.160132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.160758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.161082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.161362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.170421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.172170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739bf42-15f4-40ea-a38e-211cce73174e service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.183584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 716/1424] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:21.614326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a32dd-88e5-4eb0-bf43-0ddf2e2d3cce None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.614861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a32dd-88e5-4eb0-bf43-0ddf2e2d3cce None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.614861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a32dd-88e5-4eb0-bf43-0ddf2e2d3cce None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.616538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 709/1425] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:21.622466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeda07-e704-4493-b660-e0267eb42eb9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.622856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeda07-e704-4493-b660-e0267eb42eb9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.623020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeda07-e704-4493-b660-e0267eb42eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.641971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a2aeda07-e704-4493-b660-e0267eb42eb9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:21.643200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a2aeda07-e704-4493-b660-e0267eb42eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.651178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 717/1426] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:21.689302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a32dd-88e5-4eb0-bf43-0ddf2e2d3cce None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.702348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a32dd-88e5-4eb0-bf43-0ddf2e2d3cce None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.706938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.707578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.707862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.708137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.718127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.720389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ea055-2fb4-4a98-94ab-f8c87103ea6f service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.732771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 710/1427] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:24.055264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723a6e-bbd1-42f3-a540-e0f6f703963d None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.055830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723a6e-bbd1-42f3-a540-e0f6f703963d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.055830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6723a6e-bbd1-42f3-a540-e0f6f703963d None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.057591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 718/1428] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:24.063499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cf0a-3a56-43ba-ad9f-1a92c3129a27 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.063927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cf0a-3a56-43ba-ad9f-1a92c3129a27 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.064046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cf0a-3a56-43ba-ad9f-1a92c3129a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.082257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7ab9cf0a-3a56-43ba-ad9f-1a92c3129a27 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:24.083455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7ab9cf0a-3a56-43ba-ad9f-1a92c3129a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.091097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 711/1429] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:24.131662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6723a6e-bbd1-42f3-a540-e0f6f703963d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.141995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6723a6e-bbd1-42f3-a540-e0f6f703963d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.145495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.146131 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.146410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.146679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.155185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.156606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493d86-4fe3-437f-ad08-54f8da769d00 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.165637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 719/1430] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:26.656616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c17b3-ce77-48ba-ae5f-0589a680aab5 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.657272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c17b3-ce77-48ba-ae5f-0589a680aab5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.657272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c17b3-ce77-48ba-ae5f-0589a680aab5 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.658888 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 712/1431] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:26 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:26.665147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcf9f-b2f6-4889-83ac-c62906940ca7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.665576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcf9f-b2f6-4889-83ac-c62906940ca7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.665708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcf9f-b2f6-4889-83ac-c62906940ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.683388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a7bbcf9f-b2f6-4889-83ac-c62906940ca7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:26.684561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a7bbcf9f-b2f6-4889-83ac-c62906940ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.692880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 720/1432] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:26.735341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c17b3-ce77-48ba-ae5f-0589a680aab5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.746239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c17b3-ce77-48ba-ae5f-0589a680aab5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.749722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.750344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.750629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.750901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.759770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:26.761217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d346d-8975-42d2-8d9e-ba5132d5f902 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:26.770230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 713/1433] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:29.218756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832c93-d765-4f55-9049-52cbe4239325 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.219357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832c93-d765-4f55-9049-52cbe4239325 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.219468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7832c93-d765-4f55-9049-52cbe4239325 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.221687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 721/1434] 10.222.0.42 () {54 vars in 926 bytes} [Tue Oct 12 16:48:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:29.227660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ae0-4fcc-40cc-b8ba-8d31d8363ba1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.228078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ae0-4fcc-40cc-b8ba-8d31d8363ba1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.228215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ae0-4fcc-40cc-b8ba-8d31d8363ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.246445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-19062ae0-4fcc-40cc-b8ba-8d31d8363ba1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.247629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-19062ae0-4fcc-40cc-b8ba-8d31d8363ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.255686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 714/1435] 10.222.0.42 () {58 vars in 1023 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:29.295906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7832c93-d765-4f55-9049-52cbe4239325 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.306982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7832c93-d765-4f55-9049-52cbe4239325 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.310513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.311147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.311433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.311703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.320615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.322082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0acaee-6378-47c8-8836-989bc9ef25dc service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.331662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 722/1436] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:40.624520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.625107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.625107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.644474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:40.645707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:40.653484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 715/1437] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:40.661899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.662417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.662521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.679848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:40.681062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:40.688736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 723/1438] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:40.693340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.702601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a855a-7cfc-4380-9ae2-8e96644991c1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.707697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.708317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.708594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.708862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.709619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:40.709922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.711511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.723279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 716/1439] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:49:40.731067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.740007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e1b8b-7730-4998-a048-c8e5b13dec81 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.753419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.754070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.754353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.754627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.755331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.757258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.791402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 724/1440] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:40.795546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.805069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef170ef-ed23-4cf1-b8ab-f3c6f9038c85 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.857765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.858441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.858708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.858984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.859720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.861674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.880965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 717/1441] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:40 2021] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:40.884996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.895390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c88531-ab88-446b-b029-fef620b0537f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.900142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.900794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.901108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.901382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.902168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.903746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.918693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 725/1442] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:40.922749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.932255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325db6d-b33b-4cd2-9b16-97b43adc17e4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.936697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.937363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.937643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.938393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.939110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.940662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9ddb-25b6-4521-9ce5-8950991513c8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:40.954030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 718/1443] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:40.958090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:40.968572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f87b03-7af7-491e-a758-57a972698f4c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:40.973224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:40.974090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:40.974373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:40.974648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] PATH_INFO: `/v3/projects/062a319606034d07bc9faf7a49fc35e7/users/116efa98d9a84a2f839a8e9d248eb7ce/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:40.991553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062a319606034d07bc9faf7a49fc35e7, user_id=116efa98d9a84a2f839a8e9d248eb7ce, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:40.994424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.008152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 726/1444] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:40 2021] PUT /identity/v3/projects/062a319606034d07bc9faf7a49fc35e7/users/116efa98d9a84a2f839a8e9d248eb7ce/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:41.020850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8c65-1eaa-49d5-ac9a-f715e63b060f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.021169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8c65-1eaa-49d5-ac9a-f715e63b060f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.021441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd8c65-1eaa-49d5-ac9a-f715e63b060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.046836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-97fd8c65-1eaa-49d5-ac9a-f715e63b060f None None] MFA Rules not processed for user `116efa98d9a84a2f839a8e9d248eb7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:41.048023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-97fd8c65-1eaa-49d5-ac9a-f715e63b060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.112683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 719/1445] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:49:41 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:41.124219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.191398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5b44-37bc-4b26-a077-85bef3046712 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.197065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.197698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.197973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.198261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.206452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.208018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.216329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 727/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:41 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:41.284798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a156bc-fc09-42ae-b262-9f5de74746d3 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.285131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a156bc-fc09-42ae-b262-9f5de74746d3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.285405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a156bc-fc09-42ae-b262-9f5de74746d3 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.287119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 720/1447] 10.222.0.42 () {52 vars in 829 bytes} [Tue Oct 12 16:49:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:49:41.290841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.350043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c145a8-df9e-4e1c-8707-c312b2e28098 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.354568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.355425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.355702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.355969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] PATH_INFO: `/v3/users/116efa98d9a84a2f839a8e9d248eb7ce` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.357182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116efa98d9a84a2f839a8e9d248eb7ce)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.358193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:49:41.358193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:49:41.358193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:49:41.359424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.428690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116efa98d9a84a2f839a8e9d248eb7ce'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.438795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116efa98d9a84a2f839a8e9d248eb7ce'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.458194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116efa98d9a84a2f839a8e9d248eb7ce'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.470814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116efa98d9a84a2f839a8e9d248eb7ce'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.471662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116efa98d9a84a2f839a8e9d248eb7ce'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:41.478021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 728/1448] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:41 2021] DELETE /identity/v3/users/116efa98d9a84a2f839a8e9d248eb7ce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:41.482408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.482695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.482971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.503498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:41.504685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.558906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 721/1449] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:49:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:41.569852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.571271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.623971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b068-f262-4ae0-b006-3609083e7132 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.628538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.629214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.629500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.629776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.638466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.640059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae5e1-4b78-4665-bd8b-b087ed0b48cf service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:41.649772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 729/1450] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:41.964740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:41.966284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:41.978837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe7ab3-464d-4864-8f85-fc20c97f771d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:41.985239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:41.987296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:41.987296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:41.987582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] PATH_INFO: `/v3/projects/062a319606034d07bc9faf7a49fc35e7` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:41.989420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062a319606034d07bc9faf7a49fc35e7)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:41.990725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:49:41.990725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:49:41.990725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:49:41.992567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:42.053227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062a319606034d07bc9faf7a49fc35e7', 'request_id': 'req-93a08e6d-ab4c-49e9-8e51-666d581824b2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:42.066499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062a319606034d07bc9faf7a49fc35e7', 'request_id': 'req-93a08e6d-ab4c-49e9-8e51-666d581824b2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:42.072261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062a319606034d07bc9faf7a49fc35e7', 'request_id': 'req-93a08e6d-ab4c-49e9-8e51-666d581824b2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:42.087451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] The token cache is being invalidate because project 062a319606034d07bc9faf7a49fc35e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:42.087732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:42.088468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-93a08e6d-ab4c-49e9-8e51-666d581824b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:42.090136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 722/1451] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:41 2021] DELETE /identity/v3/projects/062a319606034d07bc9faf7a49fc35e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:12.083992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.084588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.084588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.086625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 730/1452] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:51:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:12.091866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d09d-3d08-445b-a65c-5e4af1718a70 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.092290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d09d-3d08-445b-a65c-5e4af1718a70 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.092470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d09d-3d08-445b-a65c-5e4af1718a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.110059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-fb37d09d-3d08-445b-a65c-5e4af1718a70 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:12.111261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fb37d09d-3d08-445b-a65c-5e4af1718a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:12.169648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 723/1453] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:51:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:12.326049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:12.327748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:12.401590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8129b-506b-4812-a6a6-151c5a54ee3f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:12.407025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:12.407675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.407967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.408244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.417186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:12.418783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e56d8f-9981-4d7f-87e7-408650c2e899 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:12.429316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 731/1454] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:51:12.433062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cde21-c1fd-4bb9-b0cd-e40846a7b75f None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.433427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cde21-c1fd-4bb9-b0cd-e40846a7b75f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.433713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cde21-c1fd-4bb9-b0cd-e40846a7b75f None None] PATH_INFO: `/v3` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.435056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 724/1455] 10.222.0.69 () {54 vars in 925 bytes} [Tue Oct 12 16:51:12 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:51:12.452921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6b42-46fc-4db7-9e1a-c2d2c6695f57 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.453273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6b42-46fc-4db7-9e1a-c2d2c6695f57 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.453555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e6b42-46fc-4db7-9e1a-c2d2c6695f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.473123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6d8e6b42-46fc-4db7-9e1a-c2d2c6695f57 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:12.477258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6d8e6b42-46fc-4db7-9e1a-c2d2c6695f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:12.544163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 732/1456] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Oct 12 16:51:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:13.874756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746898-2c8a-4205-9179-d61b0af8c068 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.875429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746898-2c8a-4205-9179-d61b0af8c068 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.875429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746898-2c8a-4205-9179-d61b0af8c068 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.877408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 725/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:13.882596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a45a9-2230-4718-a001-6552934037e3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.883037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a45a9-2230-4718-a001-6552934037e3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.883216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a45a9-2230-4718-a001-6552934037e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.903093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3e6a45a9-2230-4718-a001-6552934037e3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:13.904279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3e6a45a9-2230-4718-a001-6552934037e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:13.912592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 733/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:51:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:14.065322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746898-2c8a-4205-9179-d61b0af8c068 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.082753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746898-2c8a-4205-9179-d61b0af8c068 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.089311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.089627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.089908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.090183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.099051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.100650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4de5eb-43fd-43a3-873a-5b9e8c79fbc7 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.110197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 726/1459] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:16.675909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ccb7a-242f-431d-bd21-3a94780a6085 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:16.676449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ccb7a-242f-431d-bd21-3a94780a6085 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:16.676449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ccb7a-242f-431d-bd21-3a94780a6085 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:16.678297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 734/1460] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:51:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:16.683690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2903-fbcf-44e6-8dda-44bc0b7c9295 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:16.684104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2903-fbcf-44e6-8dda-44bc0b7c9295 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:16.684242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2903-fbcf-44e6-8dda-44bc0b7c9295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:16.701652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-884c2903-fbcf-44e6-8dda-44bc0b7c9295 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:16.702840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-884c2903-fbcf-44e6-8dda-44bc0b7c9295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:16.711659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 727/1461] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:51:16 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:16.719583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ccb7a-242f-431d-bd21-3a94780a6085 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:16.733292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ccb7a-242f-431d-bd21-3a94780a6085 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:16.738205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:16.738815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:16.739088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:16.739356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:16.747210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:16.748762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216327b7-7bfe-4f98-b9b9-74219fc9547e service placement] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:16.758607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 735/1462] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:16 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:51:25.967976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eac47e-c1a8-4742-aa66-54a9a1c21f80 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:25.968525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eac47e-c1a8-4742-aa66-54a9a1c21f80 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:25.968525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eac47e-c1a8-4742-aa66-54a9a1c21f80 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:25.970354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 728/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:51:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:25.976299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9084-dc2c-4344-b1e4-e8f539d2f8f4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:25.976687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9084-dc2c-4344-b1e4-e8f539d2f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:25.976849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9084-dc2c-4344-b1e4-e8f539d2f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:25.995122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0eaa9084-dc2c-4344-b1e4-e8f539d2f8f4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:25.996331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0eaa9084-dc2c-4344-b1e4-e8f539d2f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:26.005242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 736/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:51:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:26.159964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eac47e-c1a8-4742-aa66-54a9a1c21f80 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:26.177110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eac47e-c1a8-4742-aa66-54a9a1c21f80 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:26.182708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:26.183343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:26.183618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:26.183884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:26.193146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:26.194741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794a62-ebe5-4396-969e-62d53bdf57a7 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:26.204016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 729/1465] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:27.639732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8456-b174-482a-84f7-23190e52b3a4 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:27.640249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8456-b174-482a-84f7-23190e52b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:27.640249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a8456-b174-482a-84f7-23190e52b3a4 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:27.642017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 737/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:51:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:27.647177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369680c-2efd-4fdf-82b0-da8b9447b28f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:27.647566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369680c-2efd-4fdf-82b0-da8b9447b28f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:27.647717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369680c-2efd-4fdf-82b0-da8b9447b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:27.665806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7369680c-2efd-4fdf-82b0-da8b9447b28f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:27.666988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7369680c-2efd-4fdf-82b0-da8b9447b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:27.674647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 730/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:51:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:27.827779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a8456-b174-482a-84f7-23190e52b3a4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:27.842218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a8456-b174-482a-84f7-23190e52b3a4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:27.848184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:27.848795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:27.849096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:27.849366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:27.857365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:27.858986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342c3f8-a6ce-451f-816e-1eb0140528af service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:27.868234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 738/1468] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:32.437979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:32.438566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:32.438788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:32.441600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 731/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:51:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:32.447681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8b4e-6fca-4659-ad1d-46fd1a3ebf1f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:32.448197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8b4e-6fca-4659-ad1d-46fd1a3ebf1f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:32.448197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f8b4e-6fca-4659-ad1d-46fd1a3ebf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:32.466125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d60f8b4e-6fca-4659-ad1d-46fd1a3ebf1f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:32.467299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d60f8b4e-6fca-4659-ad1d-46fd1a3ebf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:32.475557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 739/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:51:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:32.514393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:32.516037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:32.571058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafd6cf-1f83-4fbc-9798-955c701d600a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:32.574519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:32.575150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:32.575431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:32.575706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:32.585037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:32.586452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f0133-a945-40a4-a51c-8dbdf2ba0be8 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:32.595816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 732/1471] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:34.857857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9de6-28d3-4cd3-b182-cb875781cd44 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:34.858430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9de6-28d3-4cd3-b182-cb875781cd44 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:34.858430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9de6-28d3-4cd3-b182-cb875781cd44 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:34.860177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 740/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:51:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:34.866617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bc9d-14c2-40a6-850a-2a4de63bbeb6 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:34.867027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bc9d-14c2-40a6-850a-2a4de63bbeb6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:34.867174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067bc9d-14c2-40a6-850a-2a4de63bbeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:34.884570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d067bc9d-14c2-40a6-850a-2a4de63bbeb6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:34.885786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d067bc9d-14c2-40a6-850a-2a4de63bbeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:34.893465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 733/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:51:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:34.931543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9de6-28d3-4cd3-b182-cb875781cd44 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:34.942246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9de6-28d3-4cd3-b182-cb875781cd44 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:34.945877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:34.946516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:34.946834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:34.947073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:34.955730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:34.957205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202ec48-be5d-4046-834c-f13e10df0a5c service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:34.966367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 741/1474] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:38.911598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:38.912169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:38.912169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:38.913978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 734/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:51:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:38.919805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc92f3-abe8-49d4-8793-b569fab1e3f4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:38.920215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc92f3-abe8-49d4-8793-b569fab1e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:38.920354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc92f3-abe8-49d4-8793-b569fab1e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:38.938371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0ffc92f3-abe8-49d4-8793-b569fab1e3f4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:38.939555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0ffc92f3-abe8-49d4-8793-b569fab1e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:38.947975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 742/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:51:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:38.999563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:39.001334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:39.056204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138904-6fb6-4e8a-beca-ce6e3c49f6b8 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:39.059713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:39.060343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:39.060619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:39.060889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:39.070062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:39.071482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c0a1-62b7-4798-ab36-b2dc2c07c090 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:39.080467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 735/1477] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:41.377357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a887-4b8a-4326-9f25-f837eaf34d86 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:41.377914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a887-4b8a-4326-9f25-f837eaf34d86 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:41.377914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a887-4b8a-4326-9f25-f837eaf34d86 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:41.379732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 743/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:41.385435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194d8-e20f-44e6-aab6-2fe090261ce4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:41.385848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194d8-e20f-44e6-aab6-2fe090261ce4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:41.385988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76194d8-e20f-44e6-aab6-2fe090261ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:41.404036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e76194d8-e20f-44e6-aab6-2fe090261ce4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:41.405262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e76194d8-e20f-44e6-aab6-2fe090261ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:41.413734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 736/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:51:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:41.465401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c8ef-63f5-4765-95c7-c822ebfbf38e None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:41.465683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c8ef-63f5-4765-95c7-c822ebfbf38e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:41.465959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3c8ef-63f5-4765-95c7-c822ebfbf38e None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:41.467732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 744/1480] 10.222.0.42 () {54 vars in 962 bytes} [Tue Oct 12 16:51:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:51:41.473748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657fd-60ab-4ca3-94fd-15196ea8c711 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:41.474037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657fd-60ab-4ca3-94fd-15196ea8c711 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:41.474315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37657fd-60ab-4ca3-94fd-15196ea8c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:41.493030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e37657fd-60ab-4ca3-94fd-15196ea8c711 None None] MFA Rules not processed for user `1052f3aba4c24b1aab7ec4ddf46cf820`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:41.494243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e37657fd-60ab-4ca3-94fd-15196ea8c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:41.500731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 737/1481] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Oct 12 16:51:41 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:41.508939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3c8ef-63f5-4765-95c7-c822ebfbf38e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:41.519828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3c8ef-63f5-4765-95c7-c822ebfbf38e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:41.523356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:41.523979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:41.524266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:41.524534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:41.533281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:41.535382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa153c-a7f9-4a48-9e71-07536a4f5a66 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:41.544570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 745/1482] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:03.446459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b59d4-3cd8-4122-9de7-370da6926f59 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.447543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b59d4-3cd8-4122-9de7-370da6926f59 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.448060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b59d4-3cd8-4122-9de7-370da6926f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.459581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7121-e8f3-4e65-825d-9d692c4866a4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.460121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7121-e8f3-4e65-825d-9d692c4866a4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.460121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f7121-e8f3-4e65-825d-9d692c4866a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.471291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2e5b59d4-3cd8-4122-9de7-370da6926f59 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:03.472687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2e5b59d4-3cd8-4122-9de7-370da6926f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:03.484670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 738/1483] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:03.487530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a55f7121-e8f3-4e65-825d-9d692c4866a4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:03.489093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a55f7121-e8f3-4e65-825d-9d692c4866a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:03.493388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.493681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.493957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.504315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 746/1484] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:03.513217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.513516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.513777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.519312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:03.520556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:03.538084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 739/1485] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:03.542489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:03.542742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.543693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:03.557985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b010-ff6a-4221-8eaa-e64d4fea4fe5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.559343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 747/1486] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:03.563942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.567299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.567977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.568262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.568539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.569318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:03.569626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.571258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.573998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54997abc-bfeb-48df-84cc-a0a76b5e6a03 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.590560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 740/1487] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:03.592766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.593471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.593748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.594018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.594755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:03.595056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.596748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.598914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.615486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 748/1488] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:03.618512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911827f-dc1d-40b0-8b36-d6e478ddc810 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.623626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.634719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.635402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.635680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.636111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.636960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.638913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.641905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e633d7b-9dc0-417f-833e-4677947c8a9c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.654520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.655181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.655510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.655783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.656488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.658665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.691785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 741/1489] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:03.696090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.705328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 749/1490] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:03.709492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.797276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace267-8b02-4a24-a5c7-2ce078a8ef83 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.809621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.810310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.810590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.810867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.811712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.813674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.826485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf311c0-0b83-4da7-94f6-ad93b5ac14f8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.839371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.840062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.840612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.840896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.841643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.843595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.843935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 750/1491] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:03.847919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.867254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b953d-0ffa-4cb6-868e-272bf5576944 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.879156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.880427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.880981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.881477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.882498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.884354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.887883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 742/1492] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:03 2021] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:03.891745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.903570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d2a5-e2b8-4aa5-bf5b-d96f28ed54d1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.904082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 751/1493] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:03.908495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.917006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.917197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.917448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.917727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.918472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.920337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.927358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6b20-408f-420e-afd9-a4934a944c5c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.936142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 743/1494] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:03.937078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.938025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.938524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.939198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.940839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.941184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.942959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.959723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fad40-a824-4ee8-a0c4-b3aa446a5597 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.965624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 752/1495] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:03.970122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:03.973013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.973771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.974102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.974437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.975553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.977299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.992760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 744/1496] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:03 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:03.996325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d929a-24b9-4582-b910-8c9154059ea2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.996805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.011395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667256-df4c-4ec8-bd6b-22018b728eb8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.012411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.013631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.014633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.015127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] PATH_INFO: `/v3/projects/d8fb7a8c01df44dfb4966cb60dcbe595/users/71c73055c359426aa992230971e72a0e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.026405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.027308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.027588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.027863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] PATH_INFO: `/v3/projects/31b653ed0f7347d5926b40069816e47d/users/a6e4842de8e845c7af2af42f8895ea45/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.046126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fb7a8c01df44dfb4966cb60dcbe595, user_id=71c73055c359426aa992230971e72a0e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.049922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b75df-a8e1-487c-8818-adf95c468987 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.050200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b653ed0f7347d5926b40069816e47d, user_id=a6e4842de8e845c7af2af42f8895ea45, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.056969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca971a7-8560-4006-bbbf-5ec46bc4b4ff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.074509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 745/1497] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:03 2021] PUT /identity/v3/projects/31b653ed0f7347d5926b40069816e47d/users/a6e4842de8e845c7af2af42f8895ea45/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:04.075165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 753/1498] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:03 2021] PUT /identity/v3/projects/d8fb7a8c01df44dfb4966cb60dcbe595/users/71c73055c359426aa992230971e72a0e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:04.080662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.080932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.081457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.089666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18eff8-7449-4ef8-a7d3-96d868697db0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.090262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18eff8-7449-4ef8-a7d3-96d868697db0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.090747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18eff8-7449-4ef8-a7d3-96d868697db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.110695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.112495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.140357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-aa18eff8-7449-4ef8-a7d3-96d868697db0 None None] MFA Rules not processed for user `a6e4842de8e845c7af2af42f8895ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.142146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aa18eff8-7449-4ef8-a7d3-96d868697db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.193635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 746/1499] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.210585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.290847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dd3d5-3589-4f9e-b1fc-3ebbedd3e59d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.302978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.303651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.303932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.304207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.308112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 754/1500] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:04.308432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ba07-d94b-4b44-9794-0cad852ffb1e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.308681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ba07-d94b-4b44-9794-0cad852ffb1e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.308981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0ba07-d94b-4b44-9794-0cad852ffb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.322796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.324263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcbffc-d383-404f-b762-86939f5acec3 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.341346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 747/1501] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:04.342573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.342863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.343143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.372689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.373947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.382225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-dfe0ba07-d94b-4b44-9794-0cad852ffb1e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.383452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dfe0ba07-d94b-4b44-9794-0cad852ffb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.394613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 748/1502] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.395490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.413037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2547a14-e0c0-44a5-96d3-b49bbd1701dd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.418421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 755/1503] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.423248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d052ba-6747-4dc6-ab21-dbafd8d204c5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.423248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d052ba-6747-4dc6-ab21-dbafd8d204c5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.423248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d052ba-6747-4dc6-ab21-dbafd8d204c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.437104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.437360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.437650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.438376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.438694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.441187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966bb0b-b160-47b8-8d2a-a467caa47616 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.456843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f4d052ba-6747-4dc6-ab21-dbafd8d204c5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.458765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f4d052ba-6747-4dc6-ab21-dbafd8d204c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.468861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 756/1504] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.470263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28426-ed0a-4b24-a8ec-dbf48d2c5f66 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.470622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28426-ed0a-4b24-a8ec-dbf48d2c5f66 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.471583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28426-ed0a-4b24-a8ec-dbf48d2c5f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.476108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 749/1505] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:04.477433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6dad-5d44-4ea1-8c20-cb639a7cfdba None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.477726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6dad-5d44-4ea1-8c20-cb639a7cfdba None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.477991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6dad-5d44-4ea1-8c20-cb639a7cfdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.496018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9eb28426-ed0a-4b24-a8ec-dbf48d2c5f66 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.496757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8a5f6dad-5d44-4ea1-8c20-cb639a7cfdba None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.497665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9eb28426-ed0a-4b24-a8ec-dbf48d2c5f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.497992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8a5f6dad-5d44-4ea1-8c20-cb639a7cfdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.568286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 757/1506] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.569783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5157-902b-470b-b804-00f676b0496d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.570180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5157-902b-470b-b804-00f676b0496d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.570662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5157-902b-470b-b804-00f676b0496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.584346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 750/1507] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.584346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.584346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.584346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.601660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-07ff5157-902b-470b-b804-00f676b0496d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.603056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-07ff5157-902b-470b-b804-00f676b0496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.604565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.605300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.612965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 758/1508] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.614123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 751/1509] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.614684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.615120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.615292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.615716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.629896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a557d9-a14b-4967-bb9c-6177d4c338d0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.636039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.637011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.637489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.637828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.638209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.638699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.639174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:04.639587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.641319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ca63-1ac2-4bdf-b979-5639b6c54966 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.652989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 759/1510] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.652989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.655073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 752/1511] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:04.656548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.656835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.657144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.668311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50e23-5023-4691-839d-8a3c04336b12 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.673228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.674240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.674533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.674801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.675504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.677545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07410-5216-4e4c-a41b-9dca9772b877 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.681273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.682209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.692316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 753/1512] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.693348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.703766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 760/1513] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:04.704890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8711de-d0a8-48bf-84cf-850674dd88b9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.705736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8711de-d0a8-48bf-84cf-850674dd88b9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.706185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8711de-d0a8-48bf-84cf-850674dd88b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.708401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95801ede-fdab-47a1-a024-42c0150eb7d0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.713133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.713788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.714072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.714345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.715081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:04.715387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.717018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbf1af-888d-4205-bfef-964b5dfd968e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.726146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8a8711de-d0a8-48bf-84cf-850674dd88b9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.727497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8a8711de-d0a8-48bf-84cf-850674dd88b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.732445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 754/1514] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:04.734053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.734349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.734625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.744057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 761/1515] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.745557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.745935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.746308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.763235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.764508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.775340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 755/1516] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.778108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.778263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.780015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.788691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2f18-e095-4207-b0d9-5134ab919cfd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.789096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 762/1517] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:04.790090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.793696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.794420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.794771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.795111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.795821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.797844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.800337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a1dd-353a-400f-8f86-ab91c1e6e470 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.811481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725406-835a-453c-8001-90d13585e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.812420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725406-835a-453c-8001-90d13585e868 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.812978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725406-835a-453c-8001-90d13585e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.813459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725406-835a-453c-8001-90d13585e868 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.814396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725406-835a-453c-8001-90d13585e868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:04.815424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725406-835a-453c-8001-90d13585e868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.817329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725406-835a-453c-8001-90d13585e868 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.832641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 763/1518] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:04.833828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725406-835a-453c-8001-90d13585e868 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.836679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 756/1519] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:04.837767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.848499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725406-835a-453c-8001-90d13585e868 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.906513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33f594-bf7b-4313-904e-2435b1b6a329 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.912787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.913731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.913974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.914110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.914291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.914631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.914914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.915030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.915197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.916114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.916673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.917858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.927535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 764/1520] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:04.932617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.944630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35d0da-880a-4434-9460-2cb320a7a6e3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.949769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.953687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 757/1521] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:04.953849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.953849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.953849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.954150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.954246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:04.954246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.954246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.966642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 765/1522] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:04.967348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.977521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851de08-48d4-4240-a4f5-2b3b077af53b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.030333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0d2ca-8643-4517-a5e7-6350d7ae4f02 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.035137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.036109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.036492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.036879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.037108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.037772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.037916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:05.038060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.038337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.038467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.039077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:05.039380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.040383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.041031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.059574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 758/1523] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:05.060026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 766/1524] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:05.060411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.062154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.078423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ec361-5b4b-47c9-8f77-fa8b6030fad3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.079149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b199f-8340-4be2-b4ee-5cd29ee9f4e0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.084793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.085088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.085606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.085882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.085988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.086158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.086286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.086633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.086920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.087490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.089330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.089637 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.116396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 759/1525] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 290 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.117392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.128746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 767/1526] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.128746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.130326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b9973-367d-4260-ab3c-ef7a39bff557 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.212570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d67771-09a5-4987-bbde-15def8a38cd1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.216705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.218130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.218970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.220442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] PATH_INFO: `/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc/users/6985c9a3c3644615807286b0f6203931/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.222661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.223472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.223954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.224510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.225369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.227705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.255176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb8a4e4ef544ecb9a40ac944395d2bc, user_id=6985c9a3c3644615807286b0f6203931, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.258685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.273117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 768/1527] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.273117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.277130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 760/1528] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:05 2021] PUT /identity/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc/users/6985c9a3c3644615807286b0f6203931/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:05.277935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.284831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074636d1-9415-46b1-bb52-8197e0dc50b2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.351714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0d59-8ab9-47ad-aa7f-d71d099afea9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.353658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.354902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.355340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.355773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.356878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.357092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.357867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.358246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.358614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.360424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.360904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.363174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.396401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 761/1529] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.396401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.412292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 769/1530] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.412292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.474943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16aaab-c4fd-4d9d-981a-249772d8e272 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.492563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa0c9-a6de-41ce-9591-fe58bec50bd6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.498282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.499479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.500016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.500457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.501656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.504033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.515748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 770/1531] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.516869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.528724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fa548-cd89-4e33-a1a5-8329bab6596f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.534589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.535640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.536104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.536643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.537728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.540344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.542243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.543088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.543467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.543835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.544641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.547014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.567557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 771/1532] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 282 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.568774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.580994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e029fd-c653-46d4-a646-cb2b1ab05a2d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.584001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 762/1533] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.584842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.663084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.664153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.664443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.664720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.665504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.667121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.675356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8516-13a4-440b-9612-e68253344abb admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.681829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.682954 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.683776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.684282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.684589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 772/1534] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.685760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.686363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.688490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.706078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 763/1535] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.706861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.708268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1c98-997b-40b4-80c7-596fc67913e8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.718143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27dbf-64f4-4a93-8af0-1fd5aef3d430 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.719918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.720741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.721156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.721527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.722334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.724350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.728773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.729614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.729987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.730355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.731162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.733186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.754276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 773/1536] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 287 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.755721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.763120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 764/1537] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.765363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.772374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ebb2-dce4-4157-9bea-356f006482fc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.778898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.779752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.779948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95f65-9864-4cee-8647-ecb2df5c083c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.780351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.780768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.781708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.783853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.787716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.789209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.789668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.790108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.791412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.793102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.796528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 774/1538] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.797387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.809728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 765/1539] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.811320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.812856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47517812-a29a-4949-a96a-0d38714ec1a8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.818481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.820160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.820160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.820160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.820594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.823795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.825532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bf1c-a671-4932-a62b-ef31e56ac9b8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.831744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.832559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.832938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.833520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.834348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.836024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.849844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 775/1540] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:05 2021] POST /identity/v3/users => generated 284 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:05.850953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.852566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 766/1541] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.853726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.863761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39fb23-550c-4098-a646-a5dff51e21e2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.866549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b192125-e9ef-40b0-abc8-9a0bfae64708 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.870019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.871194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.871542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.871911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] PATH_INFO: `/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc/users/6985c9a3c3644615807286b0f6203931/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.874132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.874393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb8a4e4ef544ecb9a40ac944395d2bc, user_id=6985c9a3c3644615807286b0f6203931, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.875355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.875960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.876753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:05.878521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.878962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:05.880909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:05.892163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 776/1542] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:05 2021] PUT /identity/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc/users/6985c9a3c3644615807286b0f6203931/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:05.893185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.902021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 767/1543] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:05.903627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:05.917697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c41b-c4a9-4617-b1b1-d7177e49b20d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:05.995150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:05.996216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:05.996597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:05.997015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] PATH_INFO: `/v3/projects/7620025728b949fcbbcf988c3afc657d/users/8f709fd4f3e946b1bbe761ae739bc7d9/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.001672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d609d8-ac90-4a91-a0fb-17b8f6627d58 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.007388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.008275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.008642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.009071 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.009915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.011625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.017868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620025728b949fcbbcf988c3afc657d, user_id=8f709fd4f3e946b1bbe761ae739bc7d9, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.021182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.023550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 777/1544] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:05 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.024402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.042290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c85549-bf1f-4f70-9454-c570a42d8373 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.049593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 768/1545] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:05 2021] PUT /identity/v3/projects/7620025728b949fcbbcf988c3afc657d/users/8f709fd4f3e946b1bbe761ae739bc7d9/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.049593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.116151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6fe3-8bfb-49b2-80d6-e40ac7ae6732 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.121164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.121942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.122428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.122783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.123925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.125783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.128132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.128832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.129153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.129435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.130670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.132321 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557b82-bde1-4357-84d2-92996605533e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.139092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 769/1546] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.140287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.150066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 778/1547] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.151736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.152029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.152364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.154902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99e60-cd9c-422a-92d3-e36e671af02a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.164314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.164314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.164314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.164314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] PATH_INFO: `/v3/projects/3531038be7ef42149fa8f272160c7686/users/d86e0624da9446b9a7bbffc277f18ce9/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.202451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3531038be7ef42149fa8f272160c7686, user_id=d86e0624da9446b9a7bbffc277f18ce9, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.206014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.212090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] MFA Rules not processed for user `6985c9a3c3644615807286b0f6203931`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:06.213638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:06.224730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 770/1548] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:06 2021] PUT /identity/v3/projects/3531038be7ef42149fa8f272160c7686/users/d86e0624da9446b9a7bbffc277f18ce9/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.225885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.323033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 779/1549] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:06 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:06.324309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.336677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237810-43e9-4582-9405-f992ec2be6e5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.337552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e02fa-e1e9-484b-9839-4ebc9c3d5aa1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.341711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.342060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.342388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.342723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.342922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.343120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.343325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.343430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.344073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.344182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.345792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.345928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731a37a-c003-41a7-a3e9-6e1d16e1e901 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.357078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 771/1550] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.358456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.358747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.359028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.363612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 780/1551] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.363612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.373705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6af8f-4d6f-42b5-bf3b-02510da68e59 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.380606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.380999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:06.381614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.381989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.382253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:06.382451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.383747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.386061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2171a3-75b0-46ec-842f-a83e99b0c264 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.394805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 772/1552] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:06.394805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.402560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec3b9-5e4d-45a3-985a-f65f32dbc642 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.408150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 781/1553] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:06.409552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.409843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.409987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.410296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.410798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.411048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.411321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] PATH_INFO: `/v3/projects/a9b66814633f422d9d829d765eaeb174/users/05542e9d8b0a42459865b8b7224305e3/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.427670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b66814633f422d9d829d765eaeb174, user_id=05542e9d8b0a42459865b8b7224305e3, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.429334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:06.430582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.430709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:06.439230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 782/1554] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:06.440670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.453066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 773/1555] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:06 2021] PUT /identity/v3/projects/a9b66814633f422d9d829d765eaeb174/users/05542e9d8b0a42459865b8b7224305e3/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.454366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.499471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca3a9-990b-4c9a-aa02-47d553117fdd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.516872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6085f21-cd80-466d-a7e9-d2c030a2b7f6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.522564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.523559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.523915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.524267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] PATH_INFO: `/v3/projects/18e9b1cf4d0a43e482a7011281992c29/users/1406700f09834efcaaf0af8ce72984a0/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.540250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e9b1cf4d0a43e482a7011281992c29, user_id=1406700f09834efcaaf0af8ce72984a0, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.543457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.555103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.555908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.556199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.556475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.562093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 774/1556] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:06 2021] PUT /identity/v3/projects/18e9b1cf4d0a43e482a7011281992c29/users/1406700f09834efcaaf0af8ce72984a0/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.562865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.628494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.630037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.631610 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d3628-cb8f-4f96-8411-b15cf05cee04 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.638039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.639052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.639331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.639604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] PATH_INFO: `/v3/projects/9eea03ce683c4baa843d7b88acaf7c34/users/b72414efeb1e4d01b9ba6ed9cbca0125/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.640841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 783/1557] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:06.641162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.642620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:06.668189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eea03ce683c4baa843d7b88acaf7c34, user_id=b72414efeb1e4d01b9ba6ed9cbca0125, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.673683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.712027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 775/1558] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:06 2021] PUT /identity/v3/projects/9eea03ce683c4baa843d7b88acaf7c34/users/b72414efeb1e4d01b9ba6ed9cbca0125/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.712027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.727448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b50b90-b82a-4f63-9467-12d433623271 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.804064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.804848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.805601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.805926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.814185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10873d2-5bc3-45a9-842f-1dd638d8e5a0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.826299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.827415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.827736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.828468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.829696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.830748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] PATH_INFO: `/v3/projects/dec15616bded49dd90529efc9b022612/users/751286f6111d4f9d977f0243e86e878b/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.853788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 784/1559] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:06.853788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:06.876215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980cc1c-0d24-4a7c-9bce-b267341e9fe6 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:06.892851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec15616bded49dd90529efc9b022612, user_id=751286f6111d4f9d977f0243e86e878b, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.895929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912dd8e-58dd-4f7d-841a-a97f21d0ccc7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.896100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:06.896729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.897351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.897351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.921642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:06.922221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 776/1560] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:06 2021] PUT /identity/v3/projects/dec15616bded49dd90529efc9b022612/users/751286f6111d4f9d977f0243e86e878b/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:06.924467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae10341-a52a-4905-b960-08ec2f0e388c service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:06.924917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58826-fd79-424f-a1f3-2fb20db08580 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.925267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58826-fd79-424f-a1f3-2fb20db08580 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.925604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58826-fd79-424f-a1f3-2fb20db08580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.935653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 785/1561] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:06.937441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:06.937892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:06.938335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:06.993384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-dcc58826-fd79-424f-a1f3-2fb20db08580 None None] MFA Rules not processed for user `05542e9d8b0a42459865b8b7224305e3`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:06.994791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-dcc58826-fd79-424f-a1f3-2fb20db08580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.020776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] MFA Rules not processed for user `1406700f09834efcaaf0af8ce72984a0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.023548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.126213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 777/1562] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:06 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.128727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29523bc-2df4-47dc-a0f7-cd23da541467 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.129044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29523bc-2df4-47dc-a0f7-cd23da541467 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.129320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29523bc-2df4-47dc-a0f7-cd23da541467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.182633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 786/1563] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.184126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:07.208345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b29523bc-2df4-47dc-a0f7-cd23da541467 None None] MFA Rules not processed for user `b72414efeb1e4d01b9ba6ed9cbca0125`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.209600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b29523bc-2df4-47dc-a0f7-cd23da541467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.333117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 778/1564] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.335146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.336555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.337181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.341298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251148-8e7d-4ab3-b4ba-ef2576dbd0b1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:07.348973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:07.349870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.350156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.350570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] PATH_INFO: `/v3/users/a6e4842de8e845c7af2af42f8895ea45` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.353481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e4842de8e845c7af2af42f8895ea45)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:07.355167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:07.382405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] MFA Rules not processed for user `751286f6111d4f9d977f0243e86e878b`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.384077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.442236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e4842de8e845c7af2af42f8895ea45'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:07.459368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e4842de8e845c7af2af42f8895ea45'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:07.480012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 779/1565] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.483572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:07.483695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e4842de8e845c7af2af42f8895ea45'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:07.500775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e4842de8e845c7af2af42f8895ea45'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:07.501706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e848ae-4be9-4e3e-b471-d9a79ff03221 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:07.502970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fedb5b48-be00-4567-b44a-2fa2296cbd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e4842de8e845c7af2af42f8895ea45'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:07.508219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:07.509057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.509350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.509884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.510671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:07.512609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f7d4-ccee-429f-b116-c321d521a946 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:07.518692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 787/1566] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:07 2021] DELETE /identity/v3/users/a6e4842de8e845c7af2af42f8895ea45 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:07.520220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292c75-7b96-4837-a5b2-ea046aa1c973 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.520512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292c75-7b96-4837-a5b2-ea046aa1c973 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.520787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d292c75-7b96-4837-a5b2-ea046aa1c973 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.528251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 788/1567] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:53:07 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:07.530007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.530299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.533176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.535039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 789/1568] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:53:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:07.537246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:07.542886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.576921 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 780/1569] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:07.578945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290d7-f7a9-4ca2-8626-f275bc0656aa None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.579244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290d7-f7a9-4ca2-8626-f275bc0656aa None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.579526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c290d7-f7a9-4ca2-8626-f275bc0656aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.610967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d9c290d7-f7a9-4ca2-8626-f275bc0656aa None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.613259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d9c290d7-f7a9-4ca2-8626-f275bc0656aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.709870 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3523d-1a15-4974-9186-7f0829b7a903 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:07.738953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 781/1570] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.741205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.741792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.742270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.776541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.778657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.806930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:07.807623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.807940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.808511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.809055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:07.811857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20ed3-a6c5-4615-a896-8bee1526d69f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:07.858518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 790/1571] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:07.859943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:07.860238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:07.861136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:07.896166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:07.897457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:07.978804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 782/1572] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:07.979758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:07.987285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:08.000207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 791/1573] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:08.001227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.002982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:08.028465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05975b-74e2-4b56-b13f-c5fc81a6dfcf None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.072913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9601742-d9d5-4f41-b237-e3fb4eff24a3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.084424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.084933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.085275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.085520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.178827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.180354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.181510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.182467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.184209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.191769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.231839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 783/1574] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:07 2021] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:08.233630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.235275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.238073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.253125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 792/1575] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:08.254084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.263246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf655-ef0a-49d0-b397-ad27bee96cc6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.277854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.278436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8a82-5c3c-4cca-8d04-56f7e85e193f service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.280339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.281418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.282032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.283828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.288760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.297976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.298266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.299173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.299460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.307456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:08.346501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 784/1576] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:08 2021] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:08.350653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.382002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3212f96-84f8-469d-8575-f6e8baf156f5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.397692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.398667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.399160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.399718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.404915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:08.407902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.410162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.435664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 793/1577] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:08.436718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.461126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa206a3-b9b2-4ea0-97ae-d791e4c15e90 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.479100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.479789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.480070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.480347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.481120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.482801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.515785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 794/1578] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:08.527707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.554557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6dcb7-b52f-4d53-a043-acafb15ebfa2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.569864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.570222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.574466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.574843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.576041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.578521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.583350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.583738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.618041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 785/1579] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:08.618910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.622846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 795/1580] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:08.625430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.654194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eac8d-feee-4e5f-b048-be39653e5e16 service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.655213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4adf-61e8-4b32-b97a-b6752b19b61a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.665822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.666492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.666737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.667023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.667298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] PATH_INFO: `/v3/projects/da964449d49243529d2438443d0f60b6/users/c91c2ec0453742e98a304b7e5811f8c1/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.668502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.669539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.670503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] PATH_INFO: `/v3/projects/ad31205526f849b49648d39fdbfd6227/users/ea015b3daa4940d2877f31c1d3b19ec0/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.704103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da964449d49243529d2438443d0f60b6, user_id=c91c2ec0453742e98a304b7e5811f8c1, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.706563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad31205526f849b49648d39fdbfd6227, user_id=ea015b3daa4940d2877f31c1d3b19ec0, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.708351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.712595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.742021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 786/1581] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:08 2021] PUT /identity/v3/projects/da964449d49243529d2438443d0f60b6/users/c91c2ec0453742e98a304b7e5811f8c1/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:08.745635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.748536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 796/1582] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:08 2021] PUT /identity/v3/projects/ad31205526f849b49648d39fdbfd6227/users/ea015b3daa4940d2877f31c1d3b19ec0/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:08.749495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.871490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7044c7d-64ab-4c8c-ba34-be6530638678 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.885421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.886115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.886398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.886678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.887425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.890056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.894859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a94f6-44fd-4f50-9f0b-0f79802f99f2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.911098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.912100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.912381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.912706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.913444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 787/1583] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:08.913578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.915230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.918343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.937248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7f24-f6b5-4255-a56a-66c5b689fc57 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.946307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 797/1584] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:08 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:08.946907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.948254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.948884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:08.950771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.951106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] PATH_INFO: `/v3/projects/da964449d49243529d2438443d0f60b6/users/c91c2ec0453742e98a304b7e5811f8c1/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.959004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da964449d49243529d2438443d0f60b6, user_id=c91c2ec0453742e98a304b7e5811f8c1, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:08.963539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e333-008b-456b-87a3-709e04a372b9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:08.976115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0dfe4-5ab7-4706-ae77-7744f44b9efd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:08.987854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:08.989662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:08.989877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:08.990141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] PATH_INFO: `/v3/projects/ad31205526f849b49648d39fdbfd6227/users/ea015b3daa4940d2877f31c1d3b19ec0/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:08.993171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 788/1585] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:08 2021] PUT /identity/v3/projects/da964449d49243529d2438443d0f60b6/users/c91c2ec0453742e98a304b7e5811f8c1/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:08.996049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad31205526f849b49648d39fdbfd6227, user_id=ea015b3daa4940d2877f31c1d3b19ec0, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.004207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37150d7-add4-48e3-814b-52e7b1dca30f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:09.004481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226857-66b1-4e52-9980-843d448b7532 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.004722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226857-66b1-4e52-9980-843d448b7532 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.005043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226857-66b1-4e52-9980-843d448b7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.041624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 798/1586] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:08 2021] PUT /identity/v3/projects/ad31205526f849b49648d39fdbfd6227/users/ea015b3daa4940d2877f31c1d3b19ec0/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:09.043233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0dec-d1f5-436e-b861-094665e6a104 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.043527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0dec-d1f5-436e-b861-094665e6a104 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.043797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a0dec-d1f5-436e-b861-094665e6a104 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.049308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 799/1587] 10.222.0.42 () {54 vars in 912 bytes} [Tue Oct 12 16:53:09 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:09.052608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-62226857-66b1-4e52-9980-843d448b7532 None None] MFA Rules not processed for user `c91c2ec0453742e98a304b7e5811f8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:09.054354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-62226857-66b1-4e52-9980-843d448b7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.057072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.057524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.057708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.116314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] MFA Rules not processed for user `ea015b3daa4940d2877f31c1d3b19ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:09.117570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.234021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 789/1588] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:09 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:09.234021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.234021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.239424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.271177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:09.272653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.298824 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 800/1589] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:09 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:09.299751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:09.301539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.364910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 790/1590] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:09.373129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:09.374806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.472768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83cef8-bfa7-48a2-8287-7744962a059d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:09.485647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:09.486365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.486648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.486926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.501138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f1728-625b-4d4f-b390-44006df7da2f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:09.507506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:09.510173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.510173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.510173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.513440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.516076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8e181-7d4d-4daf-9b75-ef2ee6066378 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:09.523611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.527495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c3acd-28fc-4473-a570-6fbadd72a75d service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:09.534653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 801/1591] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:09 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:09.550765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acccf3-9559-41ad-8b67-10656c67882f None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.551334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acccf3-9559-41ad-8b67-10656c67882f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.553342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acccf3-9559-41ad-8b67-10656c67882f None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.557886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 791/1592] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:09 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:09.563703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 802/1593] 10.222.0.42 () {54 vars in 912 bytes} [Tue Oct 12 16:53:09 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:09.567839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.567839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.570111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.606697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:09.607911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.639993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 792/1594] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:09.660630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acccf3-9559-41ad-8b67-10656c67882f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:09.678384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acccf3-9559-41ad-8b67-10656c67882f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:09.684293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:09.686304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.686745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.687217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.706735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:09.708314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:09.709958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.712273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:09.749220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 803/1595] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:09.759634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:09.769320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6fa59-72cb-41e9-9737-fd50353f62e2 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:09.781072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:09.782436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.785502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.786701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.811583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.817399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14739-142d-43c0-9074-2baeaa4ae54a service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:09.837784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 804/1596] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:09.879298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bf27-fc3f-4624-89c3-d457fe5c66cd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:09.889468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:09.890556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:09.890904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:09.891351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] PATH_INFO: `/v3/projects/31b653ed0f7347d5926b40069816e47d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:09.902540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b653ed0f7347d5926b40069816e47d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:09.904656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:10.001217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b653ed0f7347d5926b40069816e47d', 'request_id': 'req-000d8e6b-820b-40e4-b8f1-f783d68fdabf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.018143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b653ed0f7347d5926b40069816e47d', 'request_id': 'req-000d8e6b-820b-40e4-b8f1-f783d68fdabf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.032344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b653ed0f7347d5926b40069816e47d', 'request_id': 'req-000d8e6b-820b-40e4-b8f1-f783d68fdabf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.070006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:10.070663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:10.084392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:10.114881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] The token cache is being invalidate because project 31b653ed0f7347d5926b40069816e47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:10.114881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.114881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.116177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 793/1597] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:09 2021] DELETE /identity/v3/projects/31b653ed0f7347d5926b40069816e47d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:10.118607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:10.122720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:10.151647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] MFA Rules not processed for user `8f709fd4f3e946b1bbe761ae739bc7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:10.156468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:10.345936 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8e6b-820b-40e4-b8f1-f783d68fdabf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:10.351217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:10.352365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:10.352800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:10.353380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:10.364981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 805/1598] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:10 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:10.364981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:10.364981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:10.366391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:10.498477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeae09-26d1-4b79-8d1c-6071ee9d6304 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:10.506490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:10.508142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:10.508907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:10.509539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] PATH_INFO: `/v3/users/6985c9a3c3644615807286b0f6203931` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:10.512696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6985c9a3c3644615807286b0f6203931)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:10.517424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:10.544372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:10.545991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b1ce8-681c-4f4d-98f7-a962a0973aa7 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:10.568358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 794/1599] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:10 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:10.569870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:10.570159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:10.570437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:10.605313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6985c9a3c3644615807286b0f6203931'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.614229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] MFA Rules not processed for user `8f709fd4f3e946b1bbe761ae739bc7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:10.615466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:10.621582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6985c9a3c3644615807286b0f6203931'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.645056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 795/1600] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:10 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:10.645947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6985c9a3c3644615807286b0f6203931'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.653825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6985c9a3c3644615807286b0f6203931'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.655007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6985c9a3c3644615807286b0f6203931'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:10.662864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 806/1601] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:10 2021] DELETE /identity/v3/users/6985c9a3c3644615807286b0f6203931 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:10.894993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:10.897315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:11.114170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0670-787c-497d-b0f4-0a4777f83bc2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:11.234299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:11.235797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:11.312292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:11.315305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:11.315630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:11.315907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:11.319825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:11.427395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ba77-6a77-4261-a325-6facb6b37c6f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:11.434520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:11.436129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:11.437072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:11.437613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] PATH_INFO: `/v3/users/b72414efeb1e4d01b9ba6ed9cbca0125` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:11.443592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72414efeb1e4d01b9ba6ed9cbca0125)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:11.455491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:11.535256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:11.537106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870fd4-d682-49c5-ac28-d1451bf74206 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:11.553717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 796/1602] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:10 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:11.601611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72414efeb1e4d01b9ba6ed9cbca0125'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:11.618169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72414efeb1e4d01b9ba6ed9cbca0125'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:11.638401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72414efeb1e4d01b9ba6ed9cbca0125'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:11.656575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72414efeb1e4d01b9ba6ed9cbca0125'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:11.657862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72414efeb1e4d01b9ba6ed9cbca0125'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:11.679912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 807/1603] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:11 2021] DELETE /identity/v3/users/b72414efeb1e4d01b9ba6ed9cbca0125 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:11.683613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:11.684090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:11.684385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:11.723107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:11.727466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:11.920424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 797/1604] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:11.944454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:11.946196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:12.110182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180b-1676-45cc-b7df-88c7de76717e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:12.114810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:12.115558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.116075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.116424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.139464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:12.143323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58215bab-f82d-4bee-955f-c8507b5f9ab2 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:12.192883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 808/1605] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:12.597102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:12.598779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:12.609299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4c8b-54a2-4bcb-9b1c-b0ab9be03081 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.609798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4c8b-54a2-4bcb-9b1c-b0ab9be03081 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.610148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4c8b-54a2-4bcb-9b1c-b0ab9be03081 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.613245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 809/1606] 10.222.0.42 () {54 vars in 912 bytes} [Tue Oct 12 16:53:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:53:12.627916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.628190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.628644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.643599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2436415-93c4-488b-be4d-3e8e339cd91f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:12.662409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:12.665553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.666179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.666719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] PATH_INFO: `/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.669817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb8a4e4ef544ecb9a40ac944395d2bc)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:12.675852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:12.742422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:12.750441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:12.764403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 810/1607] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 16:53:12.791916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb8a4e4ef544ecb9a40ac944395d2bc', 'request_id': 'req-c2120830-7ead-4e0a-bc6e-86903e0c9a71'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:12.793828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:12.795682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:12.815813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1cb4-6d4c-408d-aae9-9c965ee39262 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:12.822256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb8a4e4ef544ecb9a40ac944395d2bc', 'request_id': 'req-c2120830-7ead-4e0a-bc6e-86903e0c9a71'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:12.837071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb8a4e4ef544ecb9a40ac944395d2bc', 'request_id': 'req-c2120830-7ead-4e0a-bc6e-86903e0c9a71'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:12.858959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] The token cache is being invalidate because project 6fb8a4e4ef544ecb9a40ac944395d2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:12.859566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:12.861817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c2120830-7ead-4e0a-bc6e-86903e0c9a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:12.865677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 798/1608] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:12 2021] DELETE /identity/v3/projects/6fb8a4e4ef544ecb9a40ac944395d2bc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:12.872594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c9-251d-42ec-a96d-c4fe2a914df2 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.873269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c9-251d-42ec-a96d-c4fe2a914df2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.873838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5c9-251d-42ec-a96d-c4fe2a914df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.896911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-031dc5c9-251d-42ec-a96d-c4fe2a914df2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:12.898937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-031dc5c9-251d-42ec-a96d-c4fe2a914df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.025445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.026140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.026401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.026681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.034989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.071992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.075046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26eef5-916c-4b2b-81a9-3a80b3bc953a service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.123139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 799/1609] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:13.126995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.134229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.134229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.141843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 811/1610] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:13.150185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.152667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.153541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.198152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] MFA Rules not processed for user `71c73055c359426aa992230971e72a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:13.210323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.219968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:13.222297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.265412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 812/1611] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:13.266674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.295670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042c4ed-0fbf-4350-b85f-84ee96fe18f5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.311144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.312793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.313330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.313853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.315479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:13.316072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.318034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.362106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 813/1612] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:13.367843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.393515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424606ab-5bf1-4904-8489-c7d8ac1030f9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.407129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 800/1613] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:13 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:13.417494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.418179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.418462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.418741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.420571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.422675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.428271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.435938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.519991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 814/1614] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:13 2021] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:13.520931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.649190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c857-6a35-42a0-a88a-1c8e91fd196c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.715927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdcd5-f819-44e6-b936-486e50bde0de admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.722164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.723110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.723552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.724012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.725389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.731289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.778352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 815/1615] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:13 2021] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:13.779591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.806515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693a1c-0e46-4f03-af91-f2ce86c17745 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.814811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.815479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.815742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.816015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.821847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.823529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.824336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.825302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.833469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.836370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.871639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 816/1616] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:13 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:13.872845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.899838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc0ff-45df-4bfe-9982-19727f655ed9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:13.913869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:13.914909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:13.920030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:13.920608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:13.921821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.925113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.941392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:13.943018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:13.967166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 801/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:13 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:13.968013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:13.973916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:13.979879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 817/1618] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:13 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:13.989203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:14.010245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdd55-f371-4241-b972-1a8aa6dd7603 service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:14.015236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:14.016095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.016268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bebb1-3ab6-40cb-b969-b78ca439bcce admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:14.016417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.016628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] PATH_INFO: `/v3/projects/9eea03ce683c4baa843d7b88acaf7c34` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.018566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eea03ce683c4baa843d7b88acaf7c34)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:14.020467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:14.044974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:14.046276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.047019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.048573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] PATH_INFO: `/v3/projects/c980f52a64fd4789a883ebb200d7c6b4/users/a2f2942216724ed39a33ed398ade2fac/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.101908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c980f52a64fd4789a883ebb200d7c6b4, user_id=a2f2942216724ed39a33ed398ade2fac, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:14.104826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:14.142808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 818/1619] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:13 2021] PUT /identity/v3/projects/c980f52a64fd4789a883ebb200d7c6b4/users/a2f2942216724ed39a33ed398ade2fac/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:14.149832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:14.159346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:14.161181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eea03ce683c4baa843d7b88acaf7c34', 'request_id': 'req-ddf6d696-4b29-4e52-abd4-7b613d0432d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.177780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eea03ce683c4baa843d7b88acaf7c34', 'request_id': 'req-ddf6d696-4b29-4e52-abd4-7b613d0432d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.196701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eea03ce683c4baa843d7b88acaf7c34', 'request_id': 'req-ddf6d696-4b29-4e52-abd4-7b613d0432d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.230553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] The token cache is being invalidate because project 9eea03ce683c4baa843d7b88acaf7c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:14.230879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.231568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ddf6d696-4b29-4e52-abd4-7b613d0432d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.237866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 802/1620] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:13 2021] DELETE /identity/v3/projects/9eea03ce683c4baa843d7b88acaf7c34 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:14.237866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b071b-a7c3-4320-aea2-d100d9efe080 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.237866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b071b-a7c3-4320-aea2-d100d9efe080 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.237866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b071b-a7c3-4320-aea2-d100d9efe080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.326555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-757b071b-a7c3-4320-aea2-d100d9efe080 None None] MFA Rules not processed for user `a2f2942216724ed39a33ed398ade2fac`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:14.327807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-757b071b-a7c3-4320-aea2-d100d9efe080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:14.337973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170beb8-38a7-4cef-a12c-696295138b68 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:14.435490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:14.437080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.437612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.438121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] PATH_INFO: `/v3/users/751286f6111d4f9d977f0243e86e878b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.440170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751286f6111d4f9d977f0243e86e878b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:14.442861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:14.579779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 803/1621] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:14 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:14.579779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.579779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.579779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.619248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751286f6111d4f9d977f0243e86e878b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.638612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751286f6111d4f9d977f0243e86e878b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.641894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:14.643276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:14.663533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751286f6111d4f9d977f0243e86e878b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.677707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 804/1622] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:14.678899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:14.686231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751286f6111d4f9d977f0243e86e878b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.687976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751286f6111d4f9d977f0243e86e878b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:14.690349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:14.711205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a997c-c6e6-4b34-a9ca-cb76d9e61546 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:14.715187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 819/1623] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:14 2021] DELETE /identity/v3/users/751286f6111d4f9d977f0243e86e878b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:14.718269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:14.725895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:14.844392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:14.845824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.846126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.846402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] PATH_INFO: `/v3/users/1406700f09834efcaaf0af8ce72984a0` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.849001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399945ad-0ffb-4a3a-93b9-023637399968 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:14.852498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1406700f09834efcaaf0af8ce72984a0)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:14.853769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: WARNING py.warnings [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:53:14.853769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: warnings.warn(msg) Oct 12 16:53:14.853769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: Oct 12 16:53:14.855042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:14.871924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:14.873920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:14.874400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:14.875605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:14.876777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:14.882575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:14.945944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 820/1624] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:14 2021] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:14.947123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:14.950751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.010037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1406700f09834efcaaf0af8ce72984a0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:15.047499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1406700f09834efcaaf0af8ce72984a0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:15.063804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1406700f09834efcaaf0af8ce72984a0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:15.065499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1406700f09834efcaaf0af8ce72984a0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:15.066522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-88c3c8f2-e0f5-4cfb-8276-8e5433ee8c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1406700f09834efcaaf0af8ce72984a0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:15.085103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 805/1625] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:14 2021] DELETE /identity/v3/users/1406700f09834efcaaf0af8ce72984a0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:15.087791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515c8e1-1d21-41e9-af34-12fdd8bfb3a5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.088369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515c8e1-1d21-41e9-af34-12fdd8bfb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.088872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515c8e1-1d21-41e9-af34-12fdd8bfb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.117262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f515c8e1-1d21-41e9-af34-12fdd8bfb3a5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:15.119084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f515c8e1-1d21-41e9-af34-12fdd8bfb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.138295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e3edb-dd37-45b1-aaa7-22fd26787403 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.223950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 806/1626] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:15.227045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.227707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.228202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.250538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:15.253627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.274772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 807/1627] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:15.276425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.279861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.300555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff269-e817-47c1-aac3-3d512f9c5f39 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.308848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.308848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.308848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.308848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.309367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.310190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7f87-12ed-4287-928e-d4bae5b005ac admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.321619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.322701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.323191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.323692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.331469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.347182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.347565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 808/1628] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/users => generated 298 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:15.348877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.352157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.352545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.352852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.360228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 821/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:14 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:15.360741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.371851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1948-a02b-468c-8820-138395029bc8 service placement] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.377934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.378667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.378952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.379625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.380423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:15.380734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.383318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.396859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 822/1630] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:15.400542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.400542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.404333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:15.406813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.421733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 809/1631] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:15.425831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.456833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f9db0-6f1c-48e6-8151-8e35fabf712f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.473371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.474058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.475612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.476327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.477126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.486889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.520976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 810/1632] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:15.520976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.537296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07866135-5a55-4f48-976c-914d8946040d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.543804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48f72-db74-4f54-8b97-5b3273f2c9b4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.554271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.555074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.555439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.558205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.559085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.563917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.569286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.570036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.571437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.571737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.600178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.602353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.646236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 823/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:15.648144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.655963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 811/1634] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:15.655963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.664318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e2aa-890a-4b40-9967-4eb72eae57f8 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.748796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.750189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.750189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.750189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.845426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.860767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.862662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26569-3b69-4ce5-b8e7-7e6c33e6d688 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.869768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.870735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.870964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.873647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] PATH_INFO: `/v3/projects/21919bdef4d44371a91d909f7da3e69c/users/788d19e8fae545ba86b1775595d8b496/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.889548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 824/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:15.890710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.903210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120cc7-cd12-43cd-9615-b5b92b3464ae service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.911877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.915733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21919bdef4d44371a91d909f7da3e69c, user_id=788d19e8fae545ba86b1775595d8b496, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.916106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.916849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.917558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.918472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.919074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.921783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.948820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 812/1636] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:15 2021] PUT /identity/v3/projects/21919bdef4d44371a91d909f7da3e69c/users/788d19e8fae545ba86b1775595d8b496/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:15.952474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.974084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 825/1637] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/users => generated 287 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:15.976096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.009544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b05e-b1ba-48e5-8efc-c43380015ead admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.122674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0ad1f-8326-42ff-a665-95ff72677562 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.137711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.138523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.138674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.138916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.139074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.139249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.139488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.139762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.139875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.140507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.142224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.143647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.175250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 813/1638] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:16.179210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 826/1639] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:16.179403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.181243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.214249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055948b-c2ae-4f04-8d7b-3726a73a7b7a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.214587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e391a-818a-4c01-b673-8373f4433d3a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.230560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.231352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.231972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.231972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.232630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.236661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.237716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.238636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.238914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.239188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] PATH_INFO: `/v3/projects/21919bdef4d44371a91d909f7da3e69c/users/788d19e8fae545ba86b1775595d8b496/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.256145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=21919bdef4d44371a91d909f7da3e69c, user_id=788d19e8fae545ba86b1775595d8b496, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.260289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f39f-3c59-42a2-9de1-9b8b930b70ec admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.300316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 827/1640] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:16 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:16.308009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 814/1641] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:16 2021] PUT /identity/v3/projects/21919bdef4d44371a91d909f7da3e69c/users/788d19e8fae545ba86b1775595d8b496/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:16.308690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.316718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.317054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.317382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.335151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3011-b087-4cca-baad-6d9b0e3b9e82 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.441554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] MFA Rules not processed for user `788d19e8fae545ba86b1775595d8b496`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:16.443218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:16.517712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.527036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.527363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.527641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] PATH_INFO: `/v3/projects/9f727810fd0e43dd8454f680cedf718b/users/5ea36265bf7743f7bd674ad21f067884/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.587058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f727810fd0e43dd8454f680cedf718b, user_id=5ea36265bf7743f7bd674ad21f067884, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.599264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a98de-6283-48fe-9601-8ae435a3c705 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.638860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 828/1642] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:16 2021] PUT /identity/v3/projects/9f727810fd0e43dd8454f680cedf718b/users/5ea36265bf7743f7bd674ad21f067884/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:16.649434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.649752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.649981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.726086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 815/1643] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:16 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:16.728430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] MFA Rules not processed for user `5ea36265bf7743f7bd674ad21f067884`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:16.729755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:16.737656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.740966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:16.912396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5d2b-4fd3-4e95-9f9f-4d57caad316d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.957823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 829/1644] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:16 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:16.958724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.964558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.023105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.023965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.024203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.024680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.094079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.096343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.117130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 816/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:16 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:17.130091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.155721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd501d59-f2cc-4201-b3a9-750b685edd8e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.180662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f27f-cf5d-4c5a-8355-a1ed6f2cdaec service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.191211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.192395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.192677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.195132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.195939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.199775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.200105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.201632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.203869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.206108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] PATH_INFO: `/v3/projects/18e9b1cf4d0a43e482a7011281992c29` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.211838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e9b1cf4d0a43e482a7011281992c29)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.224700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: WARNING py.warnings [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:53:17.224700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: warnings.warn(msg) Oct 12 16:53:17.224700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: Oct 12 16:53:17.231640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.299862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 817/1646] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:17 2021] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:17.300260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.462159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e9b1cf4d0a43e482a7011281992c29', 'request_id': 'req-95652da0-7008-4c3e-804a-9b372bd8ad9d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.474592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e9b1cf4d0a43e482a7011281992c29', 'request_id': 'req-95652da0-7008-4c3e-804a-9b372bd8ad9d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.486509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d94a-2c98-4821-8da7-a95a03a1a960 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.535342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e9b1cf4d0a43e482a7011281992c29', 'request_id': 'req-95652da0-7008-4c3e-804a-9b372bd8ad9d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.551518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.552213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.552496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.552771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.553796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.556598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.577759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] The token cache is being invalidate because project 18e9b1cf4d0a43e482a7011281992c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:17.577969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.579886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.581880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 830/1647] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:16 2021] DELETE /identity/v3/projects/18e9b1cf4d0a43e482a7011281992c29 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:17.582693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.584654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 818/1648] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:17 2021] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:17.585932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.586174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.588057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.612411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652da0-7008-4c3e-804a-9b372bd8ad9d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.627455 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.628344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.628629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.628903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] PATH_INFO: `/v3/projects/dec15616bded49dd90529efc9b022612` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.634438 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec15616bded49dd90529efc9b022612)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.636757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.676803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d163fb-db16-424d-aed0-dfa5d8304972 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.691414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.692091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.692431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.692711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.694763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.771631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec15616bded49dd90529efc9b022612', 'request_id': 'req-78715371-c53f-4fd4-bb39-2b6236ffa1c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.787037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec15616bded49dd90529efc9b022612', 'request_id': 'req-78715371-c53f-4fd4-bb39-2b6236ffa1c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.795576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec15616bded49dd90529efc9b022612', 'request_id': 'req-78715371-c53f-4fd4-bb39-2b6236ffa1c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.806800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] The token cache is being invalidate because project dec15616bded49dd90529efc9b022612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:17.807097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.808398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:17.809666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 831/1649] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:17 2021] DELETE /identity/v3/projects/dec15616bded49dd90529efc9b022612 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:17.813322 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.815405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.816827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.818647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd23e2a-27e1-4893-ab9a-fe57bc83e850 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.834945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 819/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:17 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:17.838803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b418f-a0f3-4f6f-ad25-eb376807cd80 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.839368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b418f-a0f3-4f6f-ad25-eb376807cd80 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.839815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b418f-a0f3-4f6f-ad25-eb376807cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.865006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-177b418f-a0f3-4f6f-ad25-eb376807cd80 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:17.866672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-177b418f-a0f3-4f6f-ad25-eb376807cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.959590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 820/1651] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:17.961733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e907-791c-41cd-9e43-f31af5468ea8 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.962472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e907-791c-41cd-9e43-f31af5468ea8 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.962911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891e907-791c-41cd-9e43-f31af5468ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.970881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715371-c53f-4fd4-bb39-2b6236ffa1c3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.982932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.983631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.984637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.984637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.984993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.991727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.006233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5891e907-791c-41cd-9e43-f31af5468ea8 None None] MFA Rules not processed for user `d86e0624da9446b9a7bbffc277f18ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:18.007976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5891e907-791c-41cd-9e43-f31af5468ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.024027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 832/1652] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:17 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:18.029090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.036800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.068878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a39b-354f-4e9f-9a02-f6fd0aceae73 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.088801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.090039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.090834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.092978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] PATH_INFO: `/v3/users/ea015b3daa4940d2877f31c1d3b19ec0` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.095232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 821/1653] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:17 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:18.097800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.098268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.098689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.104857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea015b3daa4940d2877f31c1d3b19ec0)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.110695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.130231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:18.131969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.151963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 822/1654] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:18.151963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.174394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e335ef-423a-405f-aaf4-aca06172546f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.185862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.188813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.190267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.192054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] PATH_INFO: `/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31/users/1177962c27e24da99bf7ebe082665ba6/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.221394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea015b3daa4940d2877f31c1d3b19ec0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:18.227351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d02f4d2ff546a692ae9ec5046afa31, user_id=1177962c27e24da99bf7ebe082665ba6, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.237730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.238213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea015b3daa4940d2877f31c1d3b19ec0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:18.263546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 823/1655] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:18 2021] PUT /identity/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31/users/1177962c27e24da99bf7ebe082665ba6/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:18.264166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.270681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.276019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea015b3daa4940d2877f31c1d3b19ec0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:18.302689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea015b3daa4940d2877f31c1d3b19ec0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:18.305301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea015b3daa4940d2877f31c1d3b19ec0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:18.327697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 833/1656] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:18 2021] DELETE /identity/v3/users/ea015b3daa4940d2877f31c1d3b19ec0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:18.327697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.328715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.541736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e664db-78d1-4261-9bc7-abb21b87a93f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.550275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd45f-2aa3-4d84-b373-0102c29c49b4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.560035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.560692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.561022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.561281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.562026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:18.562337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.564488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.593456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 834/1657] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:18.594838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.599501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.627666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa1607-c792-4efc-b92f-12384bed41fc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.646912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.647599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.647896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.648151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.648967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.656755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.679409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 835/1658] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:18 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:18.679614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.697545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.698206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.698495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.698762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.702760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476d332-40ba-4f00-b6cb-54021abcfd00 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.704246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:18.716364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:18.718180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:18.720121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:18.726553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:18.726553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.726553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.802850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 836/1659] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:18 2021] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:18.803895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.874739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:18.879725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:18.934081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 824/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:18 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:18.935225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:18.961073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d6df5-4c0c-4ed5-b330-a0478febc1ba service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:18.999494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a83d7-9a1a-4775-a3e7-a72a422812d9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.026064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.026064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.026064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.028243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] PATH_INFO: `/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31/users/1177962c27e24da99bf7ebe082665ba6/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.030590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d02f4d2ff546a692ae9ec5046afa31, user_id=1177962c27e24da99bf7ebe082665ba6, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.034468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ccfb-c209-4aeb-8150-3ddb8716767e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.099437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 837/1661] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:18 2021] PUT /identity/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31/users/1177962c27e24da99bf7ebe082665ba6/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:19.099437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.099437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.099437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.144176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.145148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.145701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.146277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.147241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.150213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.152443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] MFA Rules not processed for user `1177962c27e24da99bf7ebe082665ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:19.163403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.201257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 825/1662] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:18 2021] POST /identity/v3/users => generated 282 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:19.202370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:19.208104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.234066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61febb4-986f-41a9-aa49-902116869b2d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.357064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.358271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.358740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.359199 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] PATH_INFO: `/v3/projects/ad31205526f849b49648d39fdbfd6227` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.361715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad31205526f849b49648d39fdbfd6227)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.376021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 838/1663] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:19 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:19.378069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:19.383632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.414309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185678b7-a9cf-4dd6-a76b-0dab6dbedc8d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.436804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.437837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.438360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.439649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.440518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.449214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.492686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 839/1664] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:19 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:19.494368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:19.511143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.525985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad31205526f849b49648d39fdbfd6227', 'request_id': 'req-ade1b1c1-274f-4ea5-bba9-886aa796096f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:19.539829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad31205526f849b49648d39fdbfd6227', 'request_id': 'req-ade1b1c1-274f-4ea5-bba9-886aa796096f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:19.552354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad31205526f849b49648d39fdbfd6227', 'request_id': 'req-ade1b1c1-274f-4ea5-bba9-886aa796096f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:19.573399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] The token cache is being invalidate because project ad31205526f849b49648d39fdbfd6227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:19.573665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:19.574927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:19.581645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 826/1665] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:19 2021] DELETE /identity/v3/projects/ad31205526f849b49648d39fdbfd6227 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:19.582606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:19.598730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.616091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d0cf-cddd-4b04-b92b-ba7620d19eca admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.696431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1b1c1-274f-4ea5-bba9-886aa796096f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.702048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.702828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.703053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.703323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.704109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.706403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a012192-1269-4979-87c6-bb20fda0f8ff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.721983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 827/1666] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:19 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:19.721983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb855-f943-4f5c-971e-5e4f521b7805 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.721983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb855-f943-4f5c-971e-5e4f521b7805 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.721983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb855-f943-4f5c-971e-5e4f521b7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.740295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.742351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.743656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9eceb855-f943-4f5c-971e-5e4f521b7805 None None] MFA Rules not processed for user `71c73055c359426aa992230971e72a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:19.744904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9eceb855-f943-4f5c-971e-5e4f521b7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.748555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.757909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.775926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.813129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 828/1667] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:19 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:19.814539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.814886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.815152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:19.900537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:19.902371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:19.935362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 829/1668] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:19.945240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:19.951895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:19.953657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ebcda-d925-4a1d-a57a-05d5e41ff6b0 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:19.969513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c9f29-058a-4a78-9755-97ae82a33719 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:19.984390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:19.985478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:19.985745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:19.985980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] PATH_INFO: `/v3/projects/e216df7ac23d4932bafc3b3cfc99820e/users/271c3b8efbe240038eaa2fce6626dcce/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.004640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216df7ac23d4932bafc3b3cfc99820e, user_id=271c3b8efbe240038eaa2fce6626dcce, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.007585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9972-fad2-4ebf-86bd-33c1b202bd3f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.013043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 840/1669] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:19 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:20.024380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.025684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.025982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.053033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 830/1670] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:19 2021] PUT /identity/v3/projects/e216df7ac23d4932bafc3b3cfc99820e/users/271c3b8efbe240038eaa2fce6626dcce/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:20.063504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.063793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.064157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.132664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:20.138175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:20.150720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] MFA Rules not processed for user `271c3b8efbe240038eaa2fce6626dcce`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:20.151971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:20.250213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 841/1671] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:20.259406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.314715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c435b-951e-41d9-a1b0-78aafa54fe67 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.327937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.327937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.327937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.328734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.330304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:20.330614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.332250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.361850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 842/1672] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:20.367532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.393432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86478-0e08-4654-a590-3a5e2f9c0445 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.420063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.420732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.421041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.421323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.423078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.425761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf346b3-79b9-4c4e-a52e-e63e36ddcfc7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.433037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 831/1673] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:20.437917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.469923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d4c3b-012e-499f-8401-312ba53e452e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.482398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.483615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.484467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.485553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.486945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.491608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.497842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 843/1674] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:20.499264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.499556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.499814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.545596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:20.546968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:20.569105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 832/1675] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:20.569105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.699807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 844/1676] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:20.701024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.785297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2237d-efab-46f5-8e38-20e8c4155370 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.821734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.824422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.826059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.826971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.828333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.838235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.857695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012567-edf6-475c-af5c-0b5ba2ffc6df None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.865768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.866275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.866659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.867048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.867892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.871016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.916962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 833/1678] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/users => generated 284 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:20.918608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 845/1677] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:20 2021] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:20.920508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.920634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:20.927038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:20.934418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f5e-c6bb-45d2-b483-93774e6940b2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.940340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.941258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.941648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.942069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.942363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1241b-0740-4129-b270-29008baf1b4c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:20.943136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.945283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.948716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:20.952032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:20.952392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:20.952717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] PATH_INFO: `/v3/users/5ea36265bf7743f7bd674ad21f067884` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:20.973565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea36265bf7743f7bd674ad21f067884)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:20.976877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:20.982188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 846/1679] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:20 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:20.983353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.010208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d97dd-55f1-407f-8a81-4277f653d55f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.019187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.020051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.020396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.020792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.021669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.023397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.045914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 847/1680] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:20 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:21.046910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.052822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea36265bf7743f7bd674ad21f067884'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.066647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84658faa-b574-483f-a5fb-21ae9f48ab97 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.070395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea36265bf7743f7bd674ad21f067884'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.075249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.076082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.076440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.077337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.077658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.080345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.081215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea36265bf7743f7bd674ad21f067884'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.082488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea36265bf7743f7bd674ad21f067884'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.083056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea36265bf7743f7bd674ad21f067884'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.100411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 848/1681] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:21.101443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.104049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.109536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 834/1682] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:20 2021] DELETE /identity/v3/users/5ea36265bf7743f7bd674ad21f067884 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:21.111223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.113294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.134692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab6e-42bf-49ab-8233-35eb107ebafe admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.227357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc12a2-1481-4b31-acc7-54bb80d11e00 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.230517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.231647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.232118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.232568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] PATH_INFO: `/v3/users/a2f2942216724ed39a33ed398ade2fac` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.233288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.233966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.234084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f2942216724ed39a33ed398ade2fac)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.234251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.234531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.236876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.237175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.308741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.310382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.317503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f2942216724ed39a33ed398ade2fac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.319098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 835/1683] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:53:21.319901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.321745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.328220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f2942216724ed39a33ed398ade2fac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.338123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4390-3fc8-4b03-a95f-18acddd0c972 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.349848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.350299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.350635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.350850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] PATH_INFO: `/v3/projects/108944c4b60d4fe0ae21c857367525be/users/4c119ed450194d06a1c1ec5e6e15b9d2/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.353821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f2942216724ed39a33ed398ade2fac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.367273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108944c4b60d4fe0ae21c857367525be, user_id=4c119ed450194d06a1c1ec5e6e15b9d2, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.373066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed0fed-11bd-4d72-af7e-329f5cd5c1e4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.373253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f2942216724ed39a33ed398ade2fac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.378081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f2942216724ed39a33ed398ade2fac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:21.390361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 849/1685] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:21 2021] DELETE /identity/v3/users/a2f2942216724ed39a33ed398ade2fac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:21.391527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.393647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 836/1685] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:21 2021] PUT /identity/v3/projects/108944c4b60d4fe0ae21c857367525be/users/4c119ed450194d06a1c1ec5e6e15b9d2/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:21.395449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.397758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.398181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.399993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.418305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:21.419859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.521568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede13b9-59af-46e2-8a81-842e25a16ce1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.523802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 837/1686] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:21.525532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.527256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.528095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.529294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.529907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.530549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] PATH_INFO: `/v3/projects/585ea553544f4776b62c6adc988232ef/users/8b14e45831484c1a970e83bc2518dc52/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.541676 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc8ce0-a3fd-45dd-8687-afb59fc1b282 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.547391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.548233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.549140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.549540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.550296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.552094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02341d8-e6df-452c-9b0f-121bead1e146 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.558008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ea553544f4776b62c6adc988232ef, user_id=8b14e45831484c1a970e83bc2518dc52, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.560736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.566016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 838/1687] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:21.572085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.572270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.572977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.593975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 850/1688] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:21 2021] PUT /identity/v3/projects/585ea553544f4776b62c6adc988232ef/users/8b14e45831484c1a970e83bc2518dc52/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:21.595038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.597092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:21.598529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.631981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.702572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 839/1689] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:21.702572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.736064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eccc1d-2ee4-49b1-8c5c-122c964b5169 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.744919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.745611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.745897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.746169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.747688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc9c65-710e-4e4a-aced-8f6f1ab0f848 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.759744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.760654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.760938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.761242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] PATH_INFO: `/v3/projects/108944c4b60d4fe0ae21c857367525be/users/4c119ed450194d06a1c1ec5e6e15b9d2/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.764183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.765671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3bff-723c-4652-b4c9-88cee38d3b2c service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.770404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108944c4b60d4fe0ae21c857367525be, user_id=4c119ed450194d06a1c1ec5e6e15b9d2, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:21.776929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 851/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:21.778366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:21.778521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138cf5-7b10-460f-a6f2-482516f86e31 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.778814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138cf5-7b10-460f-a6f2-482516f86e31 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.779104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138cf5-7b10-460f-a6f2-482516f86e31 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.781231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 852/1691] 10.222.0.42 () {54 vars in 912 bytes} [Tue Oct 12 16:53:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:21.782512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfd09-09ae-45fc-a0dc-028794113b97 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.783362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfd09-09ae-45fc-a0dc-028794113b97 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.783638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bfd09-09ae-45fc-a0dc-028794113b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.811724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-638bfd09-09ae-45fc-a0dc-028794113b97 None None] MFA Rules not processed for user `8b14e45831484c1a970e83bc2518dc52`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:21.812935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-638bfd09-09ae-45fc-a0dc-028794113b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:21.829675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 840/1692] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:21 2021] PUT /identity/v3/projects/108944c4b60d4fe0ae21c857367525be/users/4c119ed450194d06a1c1ec5e6e15b9d2/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:21.832612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:21.916801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 853/1693] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:21 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:21.919749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa32a-bb20-42af-b293-295623e1da61 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.920242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa32a-bb20-42af-b293-295623e1da61 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.921264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfa32a-bb20-42af-b293-295623e1da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.956883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b046f7-fb48-4c1d-8b0a-3b050d0a6be0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:21.962074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:21.963363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:21.963750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:21.964037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:21.973203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2ecfa32a-bb20-42af-b293-295623e1da61 None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:21.989570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ecfa32a-bb20-42af-b293-295623e1da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.015460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 854/1694] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:22.016090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.016373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.017200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.085146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] MFA Rules not processed for user `4c119ed450194d06a1c1ec5e6e15b9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:22.086353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.211405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.223034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.225372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 855/1695] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:22 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:22.226270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.246206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cb551-ef3c-4098-92aa-3e6ecc1623b1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.251868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.252555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.252832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.254980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.255763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.257709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.302211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 841/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:22.308731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.315409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.329988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 856/1697] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:22 2021] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:22.331205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.336169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.351182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c9363-a1c9-4f24-8a7e-b40c1130d804 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.468395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f0e8-6f83-4d23-9be9-2e87a702dd9b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.478169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.478842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.481252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.481484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.481612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.482468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.482962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.483394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.495280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.498674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.508594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 842/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:22.510089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.634610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.636617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.648802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 857/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:22 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:22.695173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b08d0-53f6-45eb-aa84-96b41ef4109d service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.717343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.723889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.727044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.727700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.729681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.733510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.772741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.800238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05d50-bf57-483e-bbea-91a1d9b802eb service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.800467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 843/1700] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:22 2021] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:22.804346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.823343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.830330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.830689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.831096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.833411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640d438-41d1-4958-864f-c459803c39e4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.846153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.847005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.847862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.848287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.848722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.849648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.851401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.887739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 844/1701] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:22 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:22.891474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.915431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33277a0e-3696-450a-93f3-829e063f5853 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.934515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.935832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.936354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.936850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] PATH_INFO: `/v3/projects/91661122ba9646e8a7761d96f7ded3fa/users/e817749b61be4b12b57ade728a2695ff/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.972889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91661122ba9646e8a7761d96f7ded3fa, user_id=e817749b61be4b12b57ade728a2695ff, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.982912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f6b7c-14cc-4cef-a001-f59e4d5363c4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.004168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:23.006091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.026043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 845/1702] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:22 2021] PUT /identity/v3/projects/91661122ba9646e8a7761d96f7ded3fa/users/e817749b61be4b12b57ade728a2695ff/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:23.029719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.030031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.030289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.031064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 858/1703] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:22 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:23.032640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:23.077119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:23.078384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:23.124142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d2d3d-8fdc-4531-8db8-f64615be8f31 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:23.270192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 846/1704] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Oct 12 16:53:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:23.418170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:23.421206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.425333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.426744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.430581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:23.436826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.487703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 859/1705] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:23 2021] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:23.491945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:23.509810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23912041-6069-49a0-8de3-1dfbb5c814cf None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:23.519848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:23.520848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.521247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.521624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] PATH_INFO: `/v3/projects/91661122ba9646e8a7761d96f7ded3fa/users/e817749b61be4b12b57ade728a2695ff/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.535110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91661122ba9646e8a7761d96f7ded3fa, user_id=e817749b61be4b12b57ade728a2695ff, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:23.538304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb952afb-4400-4aad-8921-929373ca6c77 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.552295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:23.555818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:23.568281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 847/1706] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:23 2021] PUT /identity/v3/projects/91661122ba9646e8a7761d96f7ded3fa/users/e817749b61be4b12b57ade728a2695ff/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:23.578359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.578658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.578946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.583271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedb96e-ebc6-41ad-b951-aa115f903231 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:23.664872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] MFA Rules not processed for user `e817749b61be4b12b57ade728a2695ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:23.670097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:23.788580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:23.789496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.789796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.790063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] PATH_INFO: `/v3/projects/9f727810fd0e43dd8454f680cedf718b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.795578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f727810fd0e43dd8454f680cedf718b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:23.803139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.879037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 848/1707] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:23 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:23.879700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:23.975033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f727810fd0e43dd8454f680cedf718b', 'request_id': 'req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:23.994228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f727810fd0e43dd8454f680cedf718b', 'request_id': 'req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.018849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f727810fd0e43dd8454f680cedf718b', 'request_id': 'req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.022673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3cad9-f8cb-4365-a07b-1fd61fd1a3b7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:24.044496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] The token cache is being invalidate because project 9f727810fd0e43dd8454f680cedf718b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:24.044916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.046844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.053634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 860/1708] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:23 2021] DELETE /identity/v3/projects/9f727810fd0e43dd8454f680cedf718b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:24.056552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:24.058948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:24.162614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:24.167010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:24.167294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:24.167572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:24.181930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:24.336646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:24.337378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5056a82-cd8a-45f2-bffa-b9f9fdbc316c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:24.338573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:24.354599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:24.355585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:24.355867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:24.356517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] PATH_INFO: `/v3/users/1177962c27e24da99bf7ebe082665ba6` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:24.358168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1177962c27e24da99bf7ebe082665ba6)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:24.360171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:24.375418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 849/1709] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:23 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:24.426246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:24.428500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:24.476373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b84444-c0ee-46ac-8970-0c9e0093774a service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:24.509954 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:24.511398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:24.511913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:24.512372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] PATH_INFO: `/v3/users/05542e9d8b0a42459865b8b7224305e3` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:24.517654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05542e9d8b0a42459865b8b7224305e3)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:24.526322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:24.549228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1177962c27e24da99bf7ebe082665ba6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.571212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1177962c27e24da99bf7ebe082665ba6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.621354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1177962c27e24da99bf7ebe082665ba6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.650385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1177962c27e24da99bf7ebe082665ba6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.651523 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1177962c27e24da99bf7ebe082665ba6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.672325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 861/1710] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:24 2021] DELETE /identity/v3/users/1177962c27e24da99bf7ebe082665ba6 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:24.682814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:24.687548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:24.785879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05542e9d8b0a42459865b8b7224305e3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.852511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3fe2-42eb-41a2-bd85-b14d8e3a3e71 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:24.859327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:24.867347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:24.885634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:24.887412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05542e9d8b0a42459865b8b7224305e3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.890493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:24.907439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05542e9d8b0a42459865b8b7224305e3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.909261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05542e9d8b0a42459865b8b7224305e3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.910295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05542e9d8b0a42459865b8b7224305e3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:24.920208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:24.937628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 850/1711] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:24 2021] DELETE /identity/v3/users/05542e9d8b0a42459865b8b7224305e3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:24.940051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:24.945878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.010811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:25.017895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:25.089376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 862/1712] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:25.092458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:25.120295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.189783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dd3c-79dd-465d-8044-e8a8988fa660 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:25.210652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:25.211344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:25.211623 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:25.211891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:25.224077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.459154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3c79-67e7-4cbf-a8ab-30db3cebb2bd service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:25.526960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:25.535269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a9c46-2662-4967-aba6-d9d99508d091 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:25.566294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 851/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:24 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:25.573859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:25.574196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:25.574479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:25.607961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:25.612597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.718926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:25.720420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:25.720921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:25.722308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] PATH_INFO: `/v3/projects/c980f52a64fd4789a883ebb200d7c6b4` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:25.724975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c980f52a64fd4789a883ebb200d7c6b4)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:25.728708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:25.776812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 852/1714] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:25.839145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:25.841333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.929227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c980f52a64fd4789a883ebb200d7c6b4', 'request_id': 'req-528feeb6-ba03-43ff-8a8e-03d49968b6e1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:25.968098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c980f52a64fd4789a883ebb200d7c6b4', 'request_id': 'req-528feeb6-ba03-43ff-8a8e-03d49968b6e1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.002546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c980f52a64fd4789a883ebb200d7c6b4', 'request_id': 'req-528feeb6-ba03-43ff-8a8e-03d49968b6e1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.028516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] The token cache is being invalidate because project c980f52a64fd4789a883ebb200d7c6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:26.028816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.031708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.039712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 863/1715] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:25 2021] DELETE /identity/v3/projects/c980f52a64fd4789a883ebb200d7c6b4 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:26.045864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b62a1-8328-4612-96a7-c4380306eb5c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:26.049680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:26.058197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:26.174709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:26.175802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:26.175802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:26.176182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:26.180933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:26.262936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528feeb6-ba03-43ff-8a8e-03d49968b6e1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:26.288512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:26.296368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:26.296667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:26.296965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] PATH_INFO: `/v3/users/788d19e8fae545ba86b1775595d8b496` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:26.299028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=788d19e8fae545ba86b1775595d8b496)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:26.301075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:26.315859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:26.317362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:26.344827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 853/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:26.451670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:26.453449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:26.471359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a7ea-e743-43da-a535-ea6630c50787 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:26.472016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788d19e8fae545ba86b1775595d8b496'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.485373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:26.488760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:26.489079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:26.489350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] PATH_INFO: `/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:26.507404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788d19e8fae545ba86b1775595d8b496'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.510454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d02f4d2ff546a692ae9ec5046afa31)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:26.520056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:26.555186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788d19e8fae545ba86b1775595d8b496'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.584188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788d19e8fae545ba86b1775595d8b496'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.585523 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-8b390b8a-27ae-4f20-8af0-5ba7d2aad8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788d19e8fae545ba86b1775595d8b496'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.611821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 864/1717] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:26 2021] DELETE /identity/v3/users/788d19e8fae545ba86b1775595d8b496 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:26.734359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d02f4d2ff546a692ae9ec5046afa31', 'request_id': 'req-db7befef-c450-452e-966f-e83001f0e201'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.762364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d02f4d2ff546a692ae9ec5046afa31', 'request_id': 'req-db7befef-c450-452e-966f-e83001f0e201'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.794156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d02f4d2ff546a692ae9ec5046afa31', 'request_id': 'req-db7befef-c450-452e-966f-e83001f0e201'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.848015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] The token cache is being invalidate because project b2d02f4d2ff546a692ae9ec5046afa31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:26.848705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.852190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:26.855454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 854/1718] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:26 2021] DELETE /identity/v3/projects/b2d02f4d2ff546a692ae9ec5046afa31 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:26.863379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ce7d-8488-466b-a075-06db4d561922 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:26.863741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ce7d-8488-466b-a075-06db4d561922 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:26.864127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ce7d-8488-466b-a075-06db4d561922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:26.914630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ad46ce7d-8488-466b-a075-06db4d561922 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:26.916345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ad46ce7d-8488-466b-a075-06db4d561922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.081265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:27.085895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.123213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 865/1719] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:27.125038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.125815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.133786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.171905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:27.175182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.200185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 866/1720] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:27.205140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:27.233311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce1a9-ce7c-42d4-98fd-862b02031013 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:27.243291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7befef-c450-452e-966f-e83001f0e201 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:27.250358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:27.250730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.252263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:27.252794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.253518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.254274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] PATH_INFO: `/v3/users/271c3b8efbe240038eaa2fce6626dcce` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.254754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.255518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.256555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=271c3b8efbe240038eaa2fce6626dcce)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:27.258253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:27.258667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:27.260229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:27.262010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:27.318348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 867/1721] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:27.322394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:27.329633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.352225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028969bd-7577-4668-8c5d-8504d44578a4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:27.365684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:27.366984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.369842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.371234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] PATH_INFO: `/v3/projects/a9b66814633f422d9d829d765eaeb174` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.388189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b66814633f422d9d829d765eaeb174)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:27.391643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:27.414597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271c3b8efbe240038eaa2fce6626dcce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.457917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271c3b8efbe240038eaa2fce6626dcce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.476059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271c3b8efbe240038eaa2fce6626dcce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.477431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271c3b8efbe240038eaa2fce6626dcce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.478292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271c3b8efbe240038eaa2fce6626dcce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.534565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 855/1722] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:27 2021] DELETE /identity/v3/users/271c3b8efbe240038eaa2fce6626dcce => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:27.535791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:27.545921 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.548282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b66814633f422d9d829d765eaeb174', 'request_id': 'req-6aba3ff1-21ca-4f57-9675-d98a194e8f81'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.564576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b66814633f422d9d829d765eaeb174', 'request_id': 'req-6aba3ff1-21ca-4f57-9675-d98a194e8f81'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.584880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b66814633f422d9d829d765eaeb174', 'request_id': 'req-6aba3ff1-21ca-4f57-9675-d98a194e8f81'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.599852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] The token cache is being invalidate because project a9b66814633f422d9d829d765eaeb174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:27.600374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.601301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6aba3ff1-21ca-4f57-9675-d98a194e8f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:27.603689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 868/1723] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:27 2021] DELETE /identity/v3/projects/a9b66814633f422d9d829d765eaeb174 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:27.605502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.605963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.606497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.675583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:27.679871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.801636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 869/1724] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:27.801948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:27.806527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:27.832283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c447-ccde-4d54-8331-4ee7c65b8fcc None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:27.842099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a53db-8528-475c-8647-284405cdfd1e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:27.850949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:27.851849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.852128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.852398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] PATH_INFO: `/v3/users/c91c2ec0453742e98a304b7e5811f8c1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.856686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:27.856871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91c2ec0453742e98a304b7e5811f8c1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:27.857400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:27.857681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:27.857956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:27.859225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:27.861417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:27.862425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.008192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 856/1725] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:27 2021] POST /identity/v3/projects => generated 377 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:28.008192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:28.019250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:28.044651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91c2ec0453742e98a304b7e5811f8c1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:28.076209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91c2ec0453742e98a304b7e5811f8c1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:28.112842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91c2ec0453742e98a304b7e5811f8c1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:28.139137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91c2ec0453742e98a304b7e5811f8c1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:28.144161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91c2ec0453742e98a304b7e5811f8c1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:28.175527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 870/1726] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:27 2021] DELETE /identity/v3/users/c91c2ec0453742e98a304b7e5811f8c1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:28.176644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:28.182212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:28.354559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728edb-7247-4d97-9326-e63163541293 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:28.380834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:28.391342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.392324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.394978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1d4f0-91d5-450e-a9df-ee12a84c60d4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:28.395501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.396470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:28.401362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.493038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 871/1727] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:28 2021] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:28.494349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:28.527691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b21ef-73bf-4bbe-ae52-ca327c2c84c1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:28.528746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:28.529971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.530262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.530640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.535038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:28.537569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:28.538404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.538815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.539196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.540106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:28.544352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618381-dd90-40f6-92e1-561aa45fdda5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.568696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 872/1728] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:28 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:28.570531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77fd-6dec-46dc-a6f3-9f20ea86e38d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.571004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77fd-6dec-46dc-a6f3-9f20ea86e38d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.571380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e77fd-6dec-46dc-a6f3-9f20ea86e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.574149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:28.577379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.599639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 857/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:28.601903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:28.602091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b61e77fd-6dec-46dc-a6f3-9f20ea86e38d None None] MFA Rules not processed for user `d86e0624da9446b9a7bbffc277f18ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:28.605559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b61e77fd-6dec-46dc-a6f3-9f20ea86e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:28.616590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e55-fd61-4741-8a87-2c99990640a2 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:28.624597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:28.627783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.629431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.629865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.632265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:28.635523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf56fa-3429-432b-bbff-df92452abebb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.660480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 858/1730] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:28 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:28.665816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755511c-a359-490c-9f8b-1dfeaa7c0da0 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.666352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755511c-a359-490c-9f8b-1dfeaa7c0da0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.667818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755511c-a359-490c-9f8b-1dfeaa7c0da0 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.674714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 859/1731] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:53:28 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:28.675666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755511c-a359-490c-9f8b-1dfeaa7c0da0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:28.706371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755511c-a359-490c-9f8b-1dfeaa7c0da0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:28.715028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:28.719400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.719964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.720891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] PATH_INFO: `/v3/projects/d16780cdab7f462daa83293ff0797475/users/8a580093b1824f2aaaf84a72e9f8211d/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.724609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 873/1732] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:28 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:28.758922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16780cdab7f462daa83293ff0797475, user_id=8a580093b1824f2aaaf84a72e9f8211d, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:28.781709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc996-d480-454f-b215-de5ac62714a8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:28.818351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.818812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.819095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.831202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 860/1733] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:28 2021] PUT /identity/v3/projects/d16780cdab7f462daa83293ff0797475/users/8a580093b1824f2aaaf84a72e9f8211d/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:28.847311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:28.848338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:28.848814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:28.873171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:28.874463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:28.943404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] MFA Rules not processed for user `8a580093b1824f2aaaf84a72e9f8211d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:28.956642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:29.129563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 874/1734] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:53:28 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:29.150366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 861/1735] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:28 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:29.156419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:29.322425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:29.324129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:29.353892 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a5e7-8c65-4b9e-a172-667cf3005063 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:29.370431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:29.371090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.371367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.371638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:29.372354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:29.378680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:29.457565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 875/1736] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:29 2021] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:29.457565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:29.475777 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d381b0-1513-4ab1-9520-f21b79d261f4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:29.594622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:29.596089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.596445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.596793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] PATH_INFO: `/v3/projects/21919bdef4d44371a91d909f7da3e69c` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:29.598162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=21919bdef4d44371a91d909f7da3e69c)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:29.601763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:29.671486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cddc2-ffa9-4652-9af6-502a0695c510 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:29.710796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21919bdef4d44371a91d909f7da3e69c', 'request_id': 'req-7f69228a-9d41-4726-aa42-94b637e289ee'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:29.722449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21919bdef4d44371a91d909f7da3e69c', 'request_id': 'req-7f69228a-9d41-4726-aa42-94b637e289ee'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:29.745218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21919bdef4d44371a91d909f7da3e69c', 'request_id': 'req-7f69228a-9d41-4726-aa42-94b637e289ee'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:29.773261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] The token cache is being invalidate because project 21919bdef4d44371a91d909f7da3e69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:29.773816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:29.775238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:29.777817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 862/1737] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:29 2021] DELETE /identity/v3/projects/21919bdef4d44371a91d909f7da3e69c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:29.778904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:29.781202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:29.813364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:29.814832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.823262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.823696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:29.825586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:29.832003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad43b-8616-484f-9857-eb709631386d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:29.873293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 876/1738] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:29 2021] POST /identity/v3/users => generated 295 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:29.874796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.875306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.875674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:29.900663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:29.902610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:29.914967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 877/1739] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:29.916633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:29.918604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:29.934485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3db7f-576d-44de-8347-d87bd605f54f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:29.949990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:29.953318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.955356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.956667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:29.959871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:29.966122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f9506-0f07-46e8-8b19-db0eca863a6f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:29.987643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 878/1740] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:29 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:29.987643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:29.987643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:29.988014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69228a-9d41-4726-aa42-94b637e289ee admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:29.988478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.014300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.015126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.015414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.015684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.018076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:30.024398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.027354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.040004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 879/1741] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:30.041059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.053175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.055415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.055949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.071602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 863/1742] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:30.072389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.074056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96591d1-76b3-45ef-9259-3d61b7fe31d6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.079210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.080602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.080881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.081185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] PATH_INFO: `/v3/projects/e216df7ac23d4932bafc3b3cfc99820e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.083776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e216df7ac23d4932bafc3b3cfc99820e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.085629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.086901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798e0f-f2dd-49a5-8b33-fbda68515bb3 service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.093676 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.095661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.095984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.096450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] PATH_INFO: `/v3/projects/f833289cad3045a599304101318a71f0/users/9ef612ac85554061bf80ea7f3c1b1164/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.114803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f833289cad3045a599304101318a71f0, user_id=9ef612ac85554061bf80ea7f3c1b1164, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.118117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.139127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 864/1743] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:30 2021] PUT /identity/v3/projects/f833289cad3045a599304101318a71f0/users/9ef612ac85554061bf80ea7f3c1b1164/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:30.139127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.164116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e216df7ac23d4932bafc3b3cfc99820e', 'request_id': 'req-5079a5f5-f69f-47e8-bf30-6dbd6d887018'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.175390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e216df7ac23d4932bafc3b3cfc99820e', 'request_id': 'req-5079a5f5-f69f-47e8-bf30-6dbd6d887018'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.189665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e216df7ac23d4932bafc3b3cfc99820e', 'request_id': 'req-5079a5f5-f69f-47e8-bf30-6dbd6d887018'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.201312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] The token cache is being invalidate because project e216df7ac23d4932bafc3b3cfc99820e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:30.201611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.202596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.207402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 880/1744] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:30 2021] DELETE /identity/v3/projects/e216df7ac23d4932bafc3b3cfc99820e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:30.208306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.210255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.246239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21841180-6ab1-4462-b1e0-ef2b89b5c6f3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.333444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a5f5-f69f-47e8-bf30-6dbd6d887018 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.339127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.339825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.340187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.340359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.341141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.342771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.357037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 881/1745] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:30 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:30.357037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.358944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.373791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af9cff-84bf-4e2d-8513-352332e3c0ed admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.379446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.380715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.381189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.381453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] PATH_INFO: `/v3/projects/da964449d49243529d2438443d0f60b6` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.393944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da964449d49243529d2438443d0f60b6)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.395912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.412988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.414171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.414626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.415055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.415947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:30.416396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.418187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.467879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 865/1746] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:30.468867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.469438 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da964449d49243529d2438443d0f60b6', 'request_id': 'req-beb2aa18-d52b-4335-8dc3-94453086bc36'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.470733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.480110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da964449d49243529d2438443d0f60b6', 'request_id': 'req-beb2aa18-d52b-4335-8dc3-94453086bc36'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.487887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da964449d49243529d2438443d0f60b6', 'request_id': 'req-beb2aa18-d52b-4335-8dc3-94453086bc36'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.492004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fb7b2-d1b4-40e4-bb8e-d5ce580e417b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.499727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] The token cache is being invalidate because project da964449d49243529d2438443d0f60b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:30.500095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.500686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.503267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 882/1747] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:30 2021] DELETE /identity/v3/projects/da964449d49243529d2438443d0f60b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:30.507479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.510325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.612153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2aa18-d52b-4335-8dc3-94453086bc36 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.618327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.619630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.620063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.620478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] PATH_INFO: `/v3/projects/f833289cad3045a599304101318a71f0/users/9ef612ac85554061bf80ea7f3c1b1164/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.625537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f833289cad3045a599304101318a71f0, user_id=9ef612ac85554061bf80ea7f3c1b1164, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.629809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.648258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.650167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.650544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.651367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] PATH_INFO: `/v3/users/4c119ed450194d06a1c1ec5e6e15b9d2` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.654867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c119ed450194d06a1c1ec5e6e15b9d2)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.668161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.670913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 883/1748] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:30 2021] PUT /identity/v3/projects/f833289cad3045a599304101318a71f0/users/9ef612ac85554061bf80ea7f3c1b1164/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:30.672286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:30.682675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.786192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c119ed450194d06a1c1ec5e6e15b9d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.816808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c119ed450194d06a1c1ec5e6e15b9d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.838903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721e064-5cf7-4c2d-84f6-f6a84d5df8a6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:30.845650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:30.846453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.846674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.846947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.848188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:30.849780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fb1c1-e2b6-4f59-8418-d5a96521631d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:30.865594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c119ed450194d06a1c1ec5e6e15b9d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.869581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c119ed450194d06a1c1ec5e6e15b9d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.870082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-137b3fc2-d850-4974-9e46-3b51d2748dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c119ed450194d06a1c1ec5e6e15b9d2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:30.900253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 866/1749] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:30 2021] DELETE /identity/v3/users/4c119ed450194d06a1c1ec5e6e15b9d2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:30.901996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.902404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.902817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.918211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 884/1750] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:30 2021] POST /identity/v3/projects => generated 389 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:30.920204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0081-b6de-42f9-961e-7b1a91c23bfd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:30.920634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0081-b6de-42f9-961e-7b1a91c23bfd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:30.920813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0081-b6de-42f9-961e-7b1a91c23bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:30.938491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:30.940696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:30.954002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6d1c0081-b6de-42f9-961e-7b1a91c23bfd None None] MFA Rules not processed for user `9ef612ac85554061bf80ea7f3c1b1164`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:30.956309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6d1c0081-b6de-42f9-961e-7b1a91c23bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.090767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 867/1751] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:31.092721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.095522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.111663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a09eb7-db8f-45ca-8ca9-94b49e44a940 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.122846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.124030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.124679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.125152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.126108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.129472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.134798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 885/1752] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:30 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:31.136454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.136896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.137395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.168233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 868/1753] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:31 2021] POST /identity/v3/users => generated 295 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:31.171972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.173546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.180202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:31.183883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.198657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 886/1754] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:31.198657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.221670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b3b67-cd8a-45f8-8114-929494113e54 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.227992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.228967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.229397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.230714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.230714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.232692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.270361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 887/1755] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:31.273878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.309653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd65b1-14d2-4c0a-9839-a8555c1348c8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.323726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.324678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.325080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.325502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.326254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:31.326815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.330452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.331141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b9b0-904b-48f3-bc81-8b39d66de965 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.338392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.339701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.340232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.340652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.344221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.366820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 888/1756] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:31.368038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.413861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1b2e-e006-4b77-93bb-b65886f388f7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.423729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.424393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.424721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.425207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.426169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.428085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.453560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 889/1757] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:31.455032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.459459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.460962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.477569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55967d1a-86c0-4d78-b513-d1cac095e305 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.483010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 869/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:31.484134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.486880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.487553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.487897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.488179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.488894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.491649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.523865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04752c63-02e4-4943-922b-7d16c2805ab4 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.537644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.538597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.538835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.539132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] PATH_INFO: `/v3/projects/0bf8fcf564c14f31a03ce7dcd9724dc5/users/ada6d5edd71f42c998e78e6abb25d91d/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.575166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 890/1759] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:31 2021] POST /identity/v3/projects => generated 409 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:31.580658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.592993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf8fcf564c14f31a03ce7dcd9724dc5, user_id=ada6d5edd71f42c998e78e6abb25d91d, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.602572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.640424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 870/1760] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:31 2021] PUT /identity/v3/projects/0bf8fcf564c14f31a03ce7dcd9724dc5/users/ada6d5edd71f42c998e78e6abb25d91d/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:31.641552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.648366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.728108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1ea5e-e134-4bf3-ab1b-6063ced7d28f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.735036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.739602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.740143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.740613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] PATH_INFO: `/v3/projects/108944c4b60d4fe0ae21c857367525be` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.742435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] RBAC: Authorizing `identity:delete_project(project_id=108944c4b60d4fe0ae21c857367525be)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.744821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.760192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ddf52-1971-4dc1-8bd2-cc0ccae16941 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:31.772755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:31.773805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.774087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.774362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.775092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:31.778960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3177eaf-bc9f-4034-be15-b1422d0657f4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:31.825325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 891/1761] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:31 2021] POST /identity/v3/users => generated 305 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:31.826786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f69a-dff2-47ab-aeca-144e3f0a7ea7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:31.827074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f69a-dff2-47ab-aeca-144e3f0a7ea7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:31.827447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f69a-dff2-47ab-aeca-144e3f0a7ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:31.837763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108944c4b60d4fe0ae21c857367525be', 'request_id': 'req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:31.844455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108944c4b60d4fe0ae21c857367525be', 'request_id': 'req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:31.851175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108944c4b60d4fe0ae21c857367525be', 'request_id': 'req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:31.878358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] The token cache is being invalidate because project 108944c4b60d4fe0ae21c857367525be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:31.878732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:31.880418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:31.888915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 871/1762] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:31 2021] DELETE /identity/v3/projects/108944c4b60d4fe0ae21c857367525be => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:31.890795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:31.899825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:31.918591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-db71f69a-dff2-47ab-aeca-144e3f0a7ea7 None None] MFA Rules not processed for user `ada6d5edd71f42c998e78e6abb25d91d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:31.920592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-db71f69a-dff2-47ab-aeca-144e3f0a7ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.030799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 892/1763] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:31 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:32.030799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.031123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.031529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.079367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160a14c-aa6a-4ab1-a6ba-d61acaee288f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.083066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:32.084690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.093530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.095404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.096110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.096523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.097887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.101171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.130914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 893/1764] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:32.130914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.130914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.143495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 872/1765] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:31 2021] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:32.148260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.151958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.169095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3fb-eb06-49cb-b3fd-dd14ce4ed9e1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.176799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.177169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf1820-ee64-4a03-a7f5-1e17104a280f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.179805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.180348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.181139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] PATH_INFO: `/v3/users/8b14e45831484c1a970e83bc2518dc52` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.182322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.183357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.183672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b14e45831484c1a970e83bc2518dc52)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.183822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.184159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.185125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.187295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a7b76-4de0-4e24-9bb0-e8d78a89f9bc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.187856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.231175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 873/1766] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:32.232695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.234177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.234528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.272082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:32.273591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.286861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b14e45831484c1a970e83bc2518dc52'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:32.295318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b14e45831484c1a970e83bc2518dc52'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:32.307503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b14e45831484c1a970e83bc2518dc52'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:32.314801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b14e45831484c1a970e83bc2518dc52'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:32.315605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b14e45831484c1a970e83bc2518dc52'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:32.322712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 894/1767] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:32 2021] DELETE /identity/v3/users/8b14e45831484c1a970e83bc2518dc52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:32.324308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.326321 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.362000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 874/1768] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:32.362852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.364130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.375874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749f0d-9b2a-4175-8d15-48ffb4188e49 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.399281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd27-0766-4256-bb33-bbc4e9e6b41a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.403929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.404720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.405054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.405308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.406080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.407716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efaf166-cb49-4455-8c83-6c3e47026e81 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.419564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 895/1769] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:32.421284 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.421631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.423457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.443953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:32.445328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.447411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.448121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.448427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.448696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.449446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.451368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.454108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 896/1770] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:32.455010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.474506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a99008-2917-4e55-a5a8-68324abe31d1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.479631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 875/1771] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:32.479866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.480446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.480787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.481193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.481545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.482388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:32.482908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.484809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.498486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 897/1772] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:32.498930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ef10-c405-4a94-b5c7-1ef5a87a90dc admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.499880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.502369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.505169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.506064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.506380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.506658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] PATH_INFO: `/v3/projects/58293dc6b1aa4d258177fd45dec903fa/users/29936dbcf1f54f428fe0bdf3d062f6fb/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.521438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58293dc6b1aa4d258177fd45dec903fa, user_id=29936dbcf1f54f428fe0bdf3d062f6fb, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.524259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.538339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 876/1773] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:32 2021] PUT /identity/v3/projects/58293dc6b1aa4d258177fd45dec903fa/users/29936dbcf1f54f428fe0bdf3d062f6fb/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:32.542456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.563244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b15b5-2ecc-488b-b1e7-79b0e7d4b0ca admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.624115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.624836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.625151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.625436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.639692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc68f4-3888-44a4-b3be-e66dee89c5b5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.644596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.645455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.645810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.646090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.646953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.648646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.666521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 877/1774] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:32.667411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.682047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264dd3a-0226-4c68-80f6-1d2a477242af admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.687232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.687895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.688186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.688463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.689258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.691192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14acb84-52c4-4995-ab23-84053c58791d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.709955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.712139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.726296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 878/1775] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:32.726296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230394-ee96-4c36-9a25-12908873091d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.726296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230394-ee96-4c36-9a25-12908873091d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.726296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230394-ee96-4c36-9a25-12908873091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.726702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 898/1776] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:32.727144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.737952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005e031-3856-4df2-9d0b-c4c6092c2a30 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:32.770184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a0230394-ee96-4c36-9a25-12908873091d None None] MFA Rules not processed for user `29936dbcf1f54f428fe0bdf3d062f6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:32.772155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a0230394-ee96-4c36-9a25-12908873091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:32.841059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:32.841059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:32.841059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:32.841059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] PATH_INFO: `/v3/projects/8c77514aede847afa12dd310d24b7e13/users/5e2d3014b794456aa05a5cd9344eb269/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:32.857083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c77514aede847afa12dd310d24b7e13, user_id=5e2d3014b794456aa05a5cd9344eb269, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:32.860441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:32.880857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 899/1777] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:32 2021] PUT /identity/v3/projects/8c77514aede847afa12dd310d24b7e13/users/5e2d3014b794456aa05a5cd9344eb269/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:32.882245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.903165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 879/1778] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:32.904662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230394-ee96-4c36-9a25-12908873091d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:32.932280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230394-ee96-4c36-9a25-12908873091d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.006779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.007409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.007696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.007974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.008726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.010386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.022261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 880/1779] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:33.024483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65687-830d-4a33-a429-9092e39552f3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.027083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.036061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.036848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.037224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.038120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.038931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.039102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d056-2f92-4a23-bf30-8996f059d1f9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.041992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.044170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.044891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.045155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.045432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.046671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.048842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.084102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 900/1780] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:32 2021] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:33.084102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.085105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 881/1781] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:33 2021] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:33.086134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.103363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897df97-6b7a-40f0-bebd-f361e463214e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.186649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.187781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.188123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.188456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] PATH_INFO: `/v3/projects/8c77514aede847afa12dd310d24b7e13/users/5e2d3014b794456aa05a5cd9344eb269/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.193919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c77514aede847afa12dd310d24b7e13, user_id=5e2d3014b794456aa05a5cd9344eb269, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.205637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.222824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50905a-b3ba-4569-b60f-1d2392cf3985 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.232667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 901/1782] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:33 2021] PUT /identity/v3/projects/8c77514aede847afa12dd310d24b7e13/users/5e2d3014b794456aa05a5cd9344eb269/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:33.233519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.356290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f457-aa9f-4732-9edc-ab36bbbfa7da admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.364855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.365741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.366108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.366250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.366579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.366795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.367078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.367355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.367669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.368105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.370202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ca4f-072c-4a48-bfd6-186cddee4e96 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.373864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.402810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 882/1783] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:33 2021] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:33.404022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.406591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 902/1784] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:33 2021] POST /identity/v3/users => generated 310 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:33.409261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.410272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.413498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.415690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.427534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403944a-7dcb-4098-83ef-3accc898ff4c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.452636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.453885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.454970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.455490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] PATH_INFO: `/v3/projects/585ea553544f4776b62c6adc988232ef` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.457583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=585ea553544f4776b62c6adc988232ef)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.459681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.484787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] MFA Rules not processed for user `5e2d3014b794456aa05a5cd9344eb269`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:33.486436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.509559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585ea553544f4776b62c6adc988232ef', 'request_id': 'req-33854277-9d11-42af-8db8-aa105d906cff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.515675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585ea553544f4776b62c6adc988232ef', 'request_id': 'req-33854277-9d11-42af-8db8-aa105d906cff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.522141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585ea553544f4776b62c6adc988232ef', 'request_id': 'req-33854277-9d11-42af-8db8-aa105d906cff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.542386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] The token cache is being invalidate because project 585ea553544f4776b62c6adc988232ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:33.542681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.543738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.545816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 883/1785] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:33 2021] DELETE /identity/v3/projects/585ea553544f4776b62c6adc988232ef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:33.549636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.552494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.587003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 903/1786] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:33 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:33.593599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.595489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.611485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc170-d351-4015-994f-4a078ed7a7ec None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.657030 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854277-9d11-42af-8db8-aa105d906cff admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.664529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.665485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.665784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.666049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.666802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.668399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.680219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 884/1787] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:33 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:33.681262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.683879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.697695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b95bc-da61-44f0-9f48-8b7060d5d508 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.699159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.700072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.700445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.700735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.701528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.702657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.703261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.703672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.703963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.704284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] PATH_INFO: `/v3/users/e817749b61be4b12b57ade728a2695ff` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.705561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e817749b61be4b12b57ade728a2695ff)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.707472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.713779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 904/1788] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:33 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:33.714611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.718076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.758194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e817749b61be4b12b57ade728a2695ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.770066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e817749b61be4b12b57ade728a2695ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.777104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e817749b61be4b12b57ade728a2695ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.777819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e817749b61be4b12b57ade728a2695ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.778440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e817749b61be4b12b57ade728a2695ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:33.792543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3178-678e-41a5-831d-6faeacef733e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.796596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 885/1789] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:33 2021] DELETE /identity/v3/users/e817749b61be4b12b57ade728a2695ff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:33.797669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.799969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.800119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.801015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.801345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.801722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.804135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.913429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac448-22f5-4b9b-90f0-75cae720d495 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.919222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:33.920360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.920775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.921405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] PATH_INFO: `/v3/projects/7b01c348ba66498b8d52d855c755b71a/users/2f939754cb21431f8762f7399653c272/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:33.922463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.925504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.943245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b01c348ba66498b8d52d855c755b71a, user_id=2f939754cb21431f8762f7399653c272, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:33.945143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 905/1790] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:33 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:33.946198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:33.946605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5d124-dedb-4ac0-8111-c7a351039f2e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:33.948457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:33.967582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8b01-ae86-4216-9978-7b73f03ce5be service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:33.969051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 886/1791] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:33 2021] PUT /identity/v3/projects/7b01c348ba66498b8d52d855c755b71a/users/2f939754cb21431f8762f7399653c272/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:33.975529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:33.976138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:33.977032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.024834 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] MFA Rules not processed for user `2f939754cb21431f8762f7399653c272`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.026256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.068852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.069931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.070367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.070673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] PATH_INFO: `/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080/users/ac71628d16df4abaa4e9f0a6fc2590a8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.091219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a146e59c86044c1fb5fff9dcfc8dc080, user_id=ac71628d16df4abaa4e9f0a6fc2590a8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.097906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.129885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 906/1792] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:33 2021] PUT /identity/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080/users/ac71628d16df4abaa4e9f0a6fc2590a8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:34.133900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.157274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 887/1793] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:33 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.162388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.164671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.192149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f24fa-e229-4921-ba16-c814b0cfe768 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.226398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216694-8836-493d-9f9b-10b09aad0db0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.240279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.241517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.242008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.242613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.243872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.252238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.263659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 907/1794] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:34.264978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.279262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f8417-7140-46cf-a904-3b6a7e8c808e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.281640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.283126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.283334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.283603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] PATH_INFO: `/v3/users/ada6d5edd71f42c998e78e6abb25d91d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.285044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada6d5edd71f42c998e78e6abb25d91d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.286400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.286943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.287221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.287670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.287906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.288907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.290755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.325253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 908/1795] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:34.326123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.342442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada6d5edd71f42c998e78e6abb25d91d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.354165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada6d5edd71f42c998e78e6abb25d91d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.361164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada6d5edd71f42c998e78e6abb25d91d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.361865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada6d5edd71f42c998e78e6abb25d91d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.362519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada6d5edd71f42c998e78e6abb25d91d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.375182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 888/1796] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:34 2021] DELETE /identity/v3/users/ada6d5edd71f42c998e78e6abb25d91d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:34.377826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.379338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.386576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28667d-750e-4a42-a36b-0734c1500be5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.442353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc8f-d47a-458c-a278-fee3313e0d3f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.442942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.443854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.444132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.444401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] PATH_INFO: `/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080/users/ac71628d16df4abaa4e9f0a6fc2590a8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.446506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a146e59c86044c1fb5fff9dcfc8dc080, user_id=ac71628d16df4abaa4e9f0a6fc2590a8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.447363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.448240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.448527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.448806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] PATH_INFO: `/v3/projects/91661122ba9646e8a7761d96f7ded3fa` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.449289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.450664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91661122ba9646e8a7761d96f7ded3fa)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.452589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.459785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 909/1797] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:34 2021] PUT /identity/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080/users/ac71628d16df4abaa4e9f0a6fc2590a8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:34.460542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.462174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.510441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91661122ba9646e8a7761d96f7ded3fa', 'request_id': 'req-ea27c89b-5736-4ba5-8ef5-559532e52d5a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.518021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91661122ba9646e8a7761d96f7ded3fa', 'request_id': 'req-ea27c89b-5736-4ba5-8ef5-559532e52d5a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.524026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91661122ba9646e8a7761d96f7ded3fa', 'request_id': 'req-ea27c89b-5736-4ba5-8ef5-559532e52d5a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.533005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff972-4433-4156-8ce1-011f0307a28b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.539860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] The token cache is being invalidate because project 91661122ba9646e8a7761d96f7ded3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:34.540162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.540832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ea27c89b-5736-4ba5-8ef5-559532e52d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:34.543377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 889/1798] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:34 2021] DELETE /identity/v3/projects/91661122ba9646e8a7761d96f7ded3fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:34.544743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b33d-f227-4eb3-87a5-6b90b484643e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.545121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b33d-f227-4eb3-87a5-6b90b484643e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.545409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b33d-f227-4eb3-87a5-6b90b484643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.569156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f0d2b33d-f227-4eb3-87a5-6b90b484643e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.570634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f0d2b33d-f227-4eb3-87a5-6b90b484643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.601649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.602323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.602602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.602871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.603578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.605581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8892b-c83d-40af-82d4-c45c3196045d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.629877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 910/1799] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:34.629877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fb8-380c-46c9-98e2-b15006f14629 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.629877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fb8-380c-46c9-98e2-b15006f14629 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.629877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fb8-380c-46c9-98e2-b15006f14629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.644808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 890/1800] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.644808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.644808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.644808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.658222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ac574fb8-380c-46c9-98e2-b15006f14629 None None] MFA Rules not processed for user `ac71628d16df4abaa4e9f0a6fc2590a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.659565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ac574fb8-380c-46c9-98e2-b15006f14629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.667227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.668465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.676976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 891/1801] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.677922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.679188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.690798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0220aa0-09cc-409c-9e24-b8e096ae40e1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.695480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.696260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.696541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.696814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.697585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.699165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.709455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 892/1802] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:34.710322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.712160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.734925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 911/1803] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.736250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.736534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.736801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.754580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.755761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.764010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 912/1804] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.764683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.771216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0edcd-690e-4c75-b449-13440175128c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.774866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.775523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.775846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.776114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.776777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84041248-d38f-48ae-9e33-35c3ba18e02d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.781332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.782234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.782503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.782772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] PATH_INFO: `/v3/projects/17b629a3a3b64ec4a55cf430f0643d90/users/37eb5c8fa0ac4a89be3043e63e6a3f8a/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.785096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.786519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.796013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 893/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:34.796567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b629a3a3b64ec4a55cf430f0643d90, user_id=37eb5c8fa0ac4a89be3043e63e6a3f8a, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.796686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.798017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.799292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.813102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 913/1806] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:34 2021] PUT /identity/v3/projects/17b629a3a3b64ec4a55cf430f0643d90/users/37eb5c8fa0ac4a89be3043e63e6a3f8a/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:34.814521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.860746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119026f-7d59-468e-bb6a-c761cb2c9058 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.902654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2b33-ccb0-4fb7-b1a5-9252e75bb4ad admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.911874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.912549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.912841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.913155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.913904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:34.914207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.915827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.927539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.928340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 914/1807] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:34.929219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.929978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.930614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.931227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.943422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdaebf-6735-476d-a53f-ba5ab4f6fc39 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.949091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.949923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.950282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.950615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.951632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.953302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.964448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 915/1808] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:34.968293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.978331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa831-a4eb-44b2-9922-8904aa681ddb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.985065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.985822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.986107 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.986383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.987107 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.989714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.013419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.014797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.026679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 916/1809] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:35.026679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.030950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 894/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:35.031918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.045125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772532-5345-473a-9624-140c8bc18839 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.095075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff864c7c-9412-4301-8032-1332466f5c81 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.101519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.107660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.108003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.108287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] PATH_INFO: `/v3/projects/17b629a3a3b64ec4a55cf430f0643d90/users/37eb5c8fa0ac4a89be3043e63e6a3f8a/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.111376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b629a3a3b64ec4a55cf430f0643d90, user_id=37eb5c8fa0ac4a89be3043e63e6a3f8a, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.114147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85124ce7-1713-476e-9511-cffeb2eb7472 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.140912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 917/1811] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:35 2021] PUT /identity/v3/projects/17b629a3a3b64ec4a55cf430f0643d90/users/37eb5c8fa0ac4a89be3043e63e6a3f8a/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:35.143490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.144168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.144448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.145403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.145896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.146128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.146983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.147455 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.148776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.181552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 895/1812] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:35 2021] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:35.182496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.184163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.189729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] MFA Rules not processed for user `37eb5c8fa0ac4a89be3043e63e6a3f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:35.190927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.197248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327283-7358-4397-8b63-ac100b2bdaff admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.257587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.258658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.259098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.259951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] PATH_INFO: `/v3/projects/0bf8fcf564c14f31a03ce7dcd9724dc5` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.261469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf8fcf564c14f31a03ce7dcd9724dc5)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.263390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.270946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 918/1813] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:35 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:35.271709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.284634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb52640-18a5-4a4d-9667-748b30f9b971 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.289464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.290120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.290398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.290667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.291402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.293040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.304741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 919/1814] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:35.305869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.320277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf8fcf564c14f31a03ce7dcd9724dc5', 'request_id': 'req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.326542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf8fcf564c14f31a03ce7dcd9724dc5', 'request_id': 'req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.331978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf8fcf564c14f31a03ce7dcd9724dc5', 'request_id': 'req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.344364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] The token cache is being invalidate because project 0bf8fcf564c14f31a03ce7dcd9724dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:35.344719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.345422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.349013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 896/1815] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:35 2021] DELETE /identity/v3/projects/0bf8fcf564c14f31a03ce7dcd9724dc5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:35.350320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.352104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.367103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d4846-f21d-4050-858e-239db9cf8b3b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.411957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0383b7-7f88-488a-9f5a-f9feb868e0fd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.415658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.416335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.416692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.416996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.421603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.425608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.426270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.426555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.426838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.428734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.483158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.484583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.486389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.487761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.493838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 897/1816] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:35 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:35.494615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.495895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.496834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 920/1817] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:35 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:35.497610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.499116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.573779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64379a-c263-4070-932a-8fb110e63ed6 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.575790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ca58-a7f4-476a-a478-1e20267859b9 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.578731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.580154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.580436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.580739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] PATH_INFO: `/v3/users/5e2d3014b794456aa05a5cd9344eb269` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.581318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.581951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2d3014b794456aa05a5cd9344eb269)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.582025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.582249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.582527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.583262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.583850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.585096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.595822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 898/1818] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:35 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:35.596887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.598788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.612389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2a6c-92b7-431a-b544-759e21a3f561 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.618163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.619233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.619516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.619791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] PATH_INFO: `/v3/users/2f939754cb21431f8762f7399653c272` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.621465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f939754cb21431f8762f7399653c272)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.624148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.659775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2d3014b794456aa05a5cd9344eb269'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.671932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2d3014b794456aa05a5cd9344eb269'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.691857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f939754cb21431f8762f7399653c272'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.694633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2d3014b794456aa05a5cd9344eb269'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.706785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2d3014b794456aa05a5cd9344eb269'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.708128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2d3014b794456aa05a5cd9344eb269'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.714557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f939754cb21431f8762f7399653c272'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.723546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 921/1819] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:35 2021] DELETE /identity/v3/users/5e2d3014b794456aa05a5cd9344eb269 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:35.727816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.728708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f939754cb21431f8762f7399653c272'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.729622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.729839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f939754cb21431f8762f7399653c272'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.730829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-c0692465-7649-4626-bbc9-7f3df8ab92a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f939754cb21431f8762f7399653c272'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:35.757529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 899/1820] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:35 2021] DELETE /identity/v3/users/2f939754cb21431f8762f7399653c272 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:35.760786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.761640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.762882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.789526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:35.790710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.823818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c7d6-acca-4ce1-bffa-21c4e8a21044 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.878069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 900/1821] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:35.892541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:35.894568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:35.914374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:35.915773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.916060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.916334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] PATH_INFO: `/v3/projects/135e5b8cc9604227843537808cf03e25/users/b7c68fd25e8a49529aa7b617b5ea3a9a/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.934334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=135e5b8cc9604227843537808cf03e25, user_id=b7c68fd25e8a49529aa7b617b5ea3a9a, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:35.937981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9707-62ad-430a-85f2-8c9eafdccf0d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:35.953898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 922/1822] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:35 2021] PUT /identity/v3/projects/135e5b8cc9604227843537808cf03e25/users/b7c68fd25e8a49529aa7b617b5ea3a9a/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:35.969756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:35.970686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:35.970970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:35.982070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68190325-803d-4b54-ab3e-2f4516ee9f6c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:35.997357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] MFA Rules not processed for user `b7c68fd25e8a49529aa7b617b5ea3a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:35.998718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.034431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.035092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.035374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.035646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.084162 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 923/1823] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:36.085919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.094433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.099801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.101172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.108893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb4ff-6b8b-486d-a477-596416fcd938 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.111103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 901/1824] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:36.112080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.113458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.115608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.117010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.117194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.117435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] PATH_INFO: `/v3/projects/8c77514aede847afa12dd310d24b7e13` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.118936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c77514aede847afa12dd310d24b7e13)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.121175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.176481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c77514aede847afa12dd310d24b7e13', 'request_id': 'req-235e91f2-beda-4ced-aa5d-12235d0775ae'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.183155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2910-5610-4a19-a102-17d7ced8ba58 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.188055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c77514aede847afa12dd310d24b7e13', 'request_id': 'req-235e91f2-beda-4ced-aa5d-12235d0775ae'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.198728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c77514aede847afa12dd310d24b7e13', 'request_id': 'req-235e91f2-beda-4ced-aa5d-12235d0775ae'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.216111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] The token cache is being invalidate because project 8c77514aede847afa12dd310d24b7e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:36.216398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.217124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-235e91f2-beda-4ced-aa5d-12235d0775ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.219418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 924/1825] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:36 2021] DELETE /identity/v3/projects/8c77514aede847afa12dd310d24b7e13 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:36.226226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b878-e673-4089-9eba-102487a699b7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.226511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b878-e673-4089-9eba-102487a699b7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.226854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b878-e673-4089-9eba-102487a699b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.241743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.242517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.242915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.243290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.245498 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.247039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b967b878-e673-4089-9eba-102487a699b7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:36.248364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b967b878-e673-4089-9eba-102487a699b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.318282 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.319774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.325211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 925/1826] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:36.332664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.332971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.333267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.336328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 902/1827] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:36.352123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:36.353378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.362271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 926/1828] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:36.366744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.379446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7bcab-69c1-4006-860e-4452d783ca07 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.384469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.385412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.385690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.385961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.386982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:36.387285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.389206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.405461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 903/1829] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:36.411729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.430269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26026002-63b7-4026-8dee-dc80947cf70e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.443167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.445739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.449672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.450430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.450796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.451142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.451990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.454051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.461761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0d51-aee6-4a29-a84d-482b5f33941d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.466941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.467796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.468073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.468344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] PATH_INFO: `/v3/projects/7b01c348ba66498b8d52d855c755b71a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.469591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b01c348ba66498b8d52d855c755b71a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.472324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.513304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 927/1830] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:36 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:36.519236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.539356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b01c348ba66498b8d52d855c755b71a', 'request_id': 'req-4b828fe8-b377-4304-aae1-866c1d2c0f8d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.546851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b01c348ba66498b8d52d855c755b71a', 'request_id': 'req-4b828fe8-b377-4304-aae1-866c1d2c0f8d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.552560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b01c348ba66498b8d52d855c755b71a', 'request_id': 'req-4b828fe8-b377-4304-aae1-866c1d2c0f8d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.567865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] The token cache is being invalidate because project 7b01c348ba66498b8d52d855c755b71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:36.568208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.568904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.570951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 904/1831] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:36 2021] DELETE /identity/v3/projects/7b01c348ba66498b8d52d855c755b71a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:36.574931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.576312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.611963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5631-c926-40d2-857f-ff237b864716 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.656910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828fe8-b377-4304-aae1-866c1d2c0f8d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.664868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.666141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.666505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.667086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] PATH_INFO: `/v3/users/37eb5c8fa0ac4a89be3043e63e6a3f8a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.668747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=37eb5c8fa0ac4a89be3043e63e6a3f8a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.670876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.675145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.675898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.676278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.676614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.677432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.679434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.710956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 928/1832] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:36 2021] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:36.715304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.718209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.736156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfd14-5d12-4ff7-add3-d9ffbfcf39fc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.746508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37eb5c8fa0ac4a89be3043e63e6a3f8a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.760372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37eb5c8fa0ac4a89be3043e63e6a3f8a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.768402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37eb5c8fa0ac4a89be3043e63e6a3f8a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.769358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37eb5c8fa0ac4a89be3043e63e6a3f8a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.769933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37eb5c8fa0ac4a89be3043e63e6a3f8a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:36.771826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.773536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.774770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.775706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.776376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.781111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.787875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 905/1833] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:36 2021] DELETE /identity/v3/users/37eb5c8fa0ac4a89be3043e63e6a3f8a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:36.801138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 929/1834] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:36 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:36.810099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.810099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:36.941904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5770b-5e9d-4f86-9f04-da5877dd4cde admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.947507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.948305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.948655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.949072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:36.950266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:36.951971 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3de86-0db1-4a14-a0c6-d35f27878e2f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:36.969664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 906/1835] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:36 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:36.972638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:36.984186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34495d05-78dd-4ef1-ac6f-d7a02742871d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:36.992411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:36.993671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:36.994395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:36.994395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] PATH_INFO: `/v3/projects/196a0905724d4484957b65d10892813b/users/9099de4c3cfb46609d7d3460dcad455f/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.033290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=196a0905724d4484957b65d10892813b, user_id=9099de4c3cfb46609d7d3460dcad455f, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:37.037043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:37.059283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 930/1836] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:36 2021] PUT /identity/v3/projects/196a0905724d4484957b65d10892813b/users/9099de4c3cfb46609d7d3460dcad455f/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:37.072165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.072378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.072772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.132521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] MFA Rules not processed for user `9099de4c3cfb46609d7d3460dcad455f`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:37.133840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.208454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 907/1837] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:37 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:37.219204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:37.221718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.344494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524802-9400-4922-bf96-7b6436f13e8a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:37.351067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:37.351951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.352554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.353118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.366285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:37.368674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:37.388604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 931/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:37 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:37.413109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:37.414739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.423655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:37.545940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb039-2603-41e9-8709-1aca19ffff4d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:37.552637 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:37.554145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.554594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.555045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] PATH_INFO: `/v3/projects/17b629a3a3b64ec4a55cf430f0643d90` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.557521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b629a3a3b64ec4a55cf430f0643d90)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:37.560744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:37.575460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523dfe0-1024-4368-a639-d0e7b5d86590 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:37.584393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:37.586488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.586929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.587283 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] PATH_INFO: `/v3/users/9099de4c3cfb46609d7d3460dcad455f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.589461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9099de4c3cfb46609d7d3460dcad455f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:37.592558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:37.670317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b629a3a3b64ec4a55cf430f0643d90', 'request_id': 'req-9229f788-4b1d-47fc-b453-62b6f40aeef5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.684798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b629a3a3b64ec4a55cf430f0643d90', 'request_id': 'req-9229f788-4b1d-47fc-b453-62b6f40aeef5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.691419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b629a3a3b64ec4a55cf430f0643d90', 'request_id': 'req-9229f788-4b1d-47fc-b453-62b6f40aeef5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.706180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9099de4c3cfb46609d7d3460dcad455f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.711071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] The token cache is being invalidate because project 17b629a3a3b64ec4a55cf430f0643d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:37.711301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.712613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9229f788-4b1d-47fc-b453-62b6f40aeef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.718500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 908/1839] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:37 2021] DELETE /identity/v3/projects/17b629a3a3b64ec4a55cf430f0643d90 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:37.720898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5bdb7-c4ee-414d-b1a1-cb5902e8fc73 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.721325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5bdb7-c4ee-414d-b1a1-cb5902e8fc73 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.721705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5bdb7-c4ee-414d-b1a1-cb5902e8fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.721819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9099de4c3cfb46609d7d3460dcad455f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.738908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9099de4c3cfb46609d7d3460dcad455f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.748703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9099de4c3cfb46609d7d3460dcad455f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.749172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7cf5bdb7-c4ee-414d-b1a1-cb5902e8fc73 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:37.749500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c262c9b6-118d-49d3-ac50-dcd51a7dc3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9099de4c3cfb46609d7d3460dcad455f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:37.750654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7cf5bdb7-c4ee-414d-b1a1-cb5902e8fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.761941 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 932/1840] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:37 2021] DELETE /identity/v3/users/9099de4c3cfb46609d7d3460dcad455f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:37.766564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.766844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.768417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.798786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:37.801225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.839970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 909/1841] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:37.847969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:37.848436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:37.848906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:37.915343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:37.917307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:37.955178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 933/1842] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:37.956111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:37.957993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:38.021131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 910/1843] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:38.022007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.023315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:38.039778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea703-1a71-4192-a308-cb10b0541d6a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.051100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.052055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.052348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.052651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.057702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:38.140267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.157835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b377-180b-4b8d-a5c5-6a2a226b70da None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.161238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.170256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.170968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.171242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.171519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.180419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 934/1844] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:37 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:38.181291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.199830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.200371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.206266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae59fc-68e4-4717-988e-7ab9aac4230a service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.225484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 911/1845] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:38.226407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.227200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.228223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.228515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.233372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:38.233877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.241605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.272717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 935/1846] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:38.276756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.290369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e84a7-f896-45ba-bae0-abcd2fc7aeca service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.298550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.299695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.300234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.300744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.301892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.315663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.359543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 912/1847] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:38 2021] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:38.359899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.370884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ba0d5-6dbf-42c7-932c-92af5ccbb0f0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.455521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.456228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.456609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.456974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.457878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.460139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.495868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.498545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 936/1848] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:38 2021] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:38.510062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f15d9-e18d-416d-8c1c-26ac79e00752 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.516959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.517844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.518350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.518481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.519292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.521010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.545479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 913/1849] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:38 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:38.554474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.567770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452be8d-ac83-46af-888b-25971a5917f1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.576507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.577273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.577650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.577992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.578751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.580651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f68a2-5860-4e25-8017-9575178e1f32 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.599710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.601360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 937/1850] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:38 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:38.619479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b15a79-8491-41cb-9781-f4186ab14b6f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.644620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.647894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.648161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.648399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] PATH_INFO: `/v3/projects/c75c30f5593e4cc5b256a31f2942e371/users/48dfe81fcade4c3ba0f80b694c5a3c9e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.691099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75c30f5593e4cc5b256a31f2942e371, user_id=48dfe81fcade4c3ba0f80b694c5a3c9e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.695803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:38.717472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 914/1851] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:38 2021] PUT /identity/v3/projects/c75c30f5593e4cc5b256a31f2942e371/users/48dfe81fcade4c3ba0f80b694c5a3c9e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:38.724426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.724897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.725504 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.754425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:38.755742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:38.845525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 938/1852] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:38.873827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:38.965381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659167fc-ba9b-404b-a9d7-467378194284 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:38.970405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:38.970845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:38.971226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:38.971608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:38.983136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:38.985064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14036ea2-2efc-4ed1-9cf9-7045d7f24f30 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.012613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 915/1853] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:39.199948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.201534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:39.230373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec859-67c9-4a16-91e2-9448ecebcf47 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.236684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.238481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.238763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.239029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] PATH_INFO: `/v3/projects/196a0905724d4484957b65d10892813b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.240357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196a0905724d4484957b65d10892813b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.242390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.311710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196a0905724d4484957b65d10892813b', 'request_id': 'req-2946d842-42dc-470b-b164-f7ce83dad9d2'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:39.321891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196a0905724d4484957b65d10892813b', 'request_id': 'req-2946d842-42dc-470b-b164-f7ce83dad9d2'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:39.333465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196a0905724d4484957b65d10892813b', 'request_id': 'req-2946d842-42dc-470b-b164-f7ce83dad9d2'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:39.354928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] The token cache is being invalidate because project 196a0905724d4484957b65d10892813b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:39.355354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:39.359975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2946d842-42dc-470b-b164-f7ce83dad9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:39.370235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9226-077e-4e5e-8a93-44964da43a86 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.370525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9226-077e-4e5e-8a93-44964da43a86 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.370802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9226-077e-4e5e-8a93-44964da43a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.372450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 939/1854] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:39 2021] DELETE /identity/v3/projects/196a0905724d4484957b65d10892813b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:39.396393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-667c9226-077e-4e5e-8a93-44964da43a86 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:39.397664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-667c9226-077e-4e5e-8a93-44964da43a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:39.410774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3cfd-16e0-4d19-a81a-7c3b47c0c0bb None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.411069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3cfd-16e0-4d19-a81a-7c3b47c0c0bb None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.411348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f3cfd-16e0-4d19-a81a-7c3b47c0c0bb None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.413868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 940/1855] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:53:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:53:39.421257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.421545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.421846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.458546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:39.460277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:39.489362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 916/1856] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:39.495346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.499852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.500417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.536576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:39.538159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:39.549913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 917/1857] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:39.554538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.565378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02e53-8147-439d-b6cb-19a2b94cbc00 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.570737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.571565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.571952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.572324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.573211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:39.573632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.575350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.591012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 918/1858] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:39.591781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 941/1859] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:39.595236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.609626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.612654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a99f2-3260-463b-a6be-67c4f8374ffd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.614990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:39.618049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.618837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.619220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.619771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.621195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.631318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.640566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bde7-957f-4b5c-85aa-22bd56ef67f9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.648544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.650274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.650746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.651028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.666731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.668729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.675590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 919/1860] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:39.676756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.687136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 942/1861] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:39.775247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f018b-6ac9-4ae5-ba49-c0b75c3022fd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.781393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.781907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.782230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.782523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.783215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.785210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.807847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 920/1862] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:39.811517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.825195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278efc3-d94d-4aa6-a6ad-9181fe38d109 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.832784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.833505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.833785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.834056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.835280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.837332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.854516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.860823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 943/1863] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:39 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:39.866054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bc3e-13fc-4dd0-9bdf-dbc85d3f0db5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.870892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.871588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.871825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.872101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.873021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.874643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef97aa-84bc-4916-af0d-2f6c5bdd3dd9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.886952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 921/1864] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:39 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:39.891046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:39.901874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda38fe-91ff-48b5-8df0-15b751bcac5a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:39.906508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:39.908055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.908363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.908633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] PATH_INFO: `/v3/projects/42b4caab9d264f53adf55d0aeea7240a/users/4c7b6c21dda54880b2ab1f00c2c2eca0/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.923049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b4caab9d264f53adf55d0aeea7240a, user_id=4c7b6c21dda54880b2ab1f00c2c2eca0, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:39.925872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84066365-e86d-449d-a411-7983d761b546 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:39.942805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 944/1865] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:39 2021] PUT /identity/v3/projects/42b4caab9d264f53adf55d0aeea7240a/users/4c7b6c21dda54880b2ab1f00c2c2eca0/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:39.953846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:39.954712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:39.954991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:39.984225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] MFA Rules not processed for user `4c7b6c21dda54880b2ab1f00c2c2eca0`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:39.985624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:40.060800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.061376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.061818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.071959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 922/1866] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:40.092991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.096668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:40.109776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] MFA Rules not processed for user `48dfe81fcade4c3ba0f80b694c5a3c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:40.111120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:40.179116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b89766-5ef1-4a15-be52-092cc4ed3208 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.185137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.185811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.186259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 945/1867] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:40 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:40.186366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.186447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.195018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.198170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:40.202115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.203707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.225768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 923/1868] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:40 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:40.285416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59655-87c6-40d1-a18f-52d68074bfc8 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.290003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.290672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.290954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.291229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.291942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.293903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.334102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 946/1869] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:40 2021] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:40.338194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.350214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2aac5-6075-4f3f-b734-f1c8ccb66225 service glance] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.428968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.429817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.430277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.430583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.431364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.433377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.456194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 924/1870] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:40 2021] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:40.457759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.468164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f215a68-643d-416f-86c0-33e6ef31e97a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.473927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.474607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.474889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.475163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.475911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.477631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.488579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 947/1871] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:40.492841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.503032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ce50-3590-4603-9951-7e01ed7c94a9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.507724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.508603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.508893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.509196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] PATH_INFO: `/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7/users/5afad5c8a77a4072a1e038a3bcd713a3/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.524328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa471dbc5b3b4301aaada0a5fe57e1f7, user_id=5afad5c8a77a4072a1e038a3bcd713a3, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.526972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.540770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 925/1872] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:40 2021] PUT /identity/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7/users/5afad5c8a77a4072a1e038a3bcd713a3/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:40.544907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.554723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f17a7e-f416-4582-8a94-ec727ad11011 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.610942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.611607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.611887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.612157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.612889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.614557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293dd4b-d8b7-4fc4-b5bb-373e1428f2f0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.624289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 948/1873] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:40.629095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:40.639658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4899-5520-408c-8c91-714ec633de88 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:40.645304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:40.646425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:40.646851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:40.647263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] PATH_INFO: `/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7/users/5afad5c8a77a4072a1e038a3bcd713a3/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:40.649416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa471dbc5b3b4301aaada0a5fe57e1f7, user_id=5afad5c8a77a4072a1e038a3bcd713a3, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:40.652531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:40.666238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 926/1874] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:40 2021] PUT /identity/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7/users/5afad5c8a77a4072a1e038a3bcd713a3/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:41.569256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:41.569720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:41.569822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:41.620745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] MFA Rules not processed for user `5afad5c8a77a4072a1e038a3bcd713a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:41.622459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:41.759684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 949/1875] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:41 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:41.809431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:41.811257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:41.885216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aa6b0-c3c5-4ac9-a577-c9317b586291 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:41.889075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:41.889728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:41.890121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:41.890398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:41.954949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:41.956493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056754a-53c7-445b-a7fc-23b6d626d038 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:41.966017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 927/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:41 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:48.603183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:48.613578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e66fb-6f7c-41f1-9ee2-97b44cd53b2b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:48.617219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:48.617916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:48.618226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:48.618500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:48.630235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:48.631785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eddeac-de84-41d7-9879-ec7815dacb4c service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:48.643424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 950/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:48 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:50.082097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b0a5-5465-45ad-a284-8930ac69da80 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.083100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b0a5-5465-45ad-a284-8930ac69da80 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.083626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226b0a5-5465-45ad-a284-8930ac69da80 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.085851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 928/1878] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:53:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:50.097228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.098853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.099338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.134519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:50.135933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.221250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 951/1879] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:53:50 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:50.236004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226b0a5-5465-45ad-a284-8930ac69da80 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:50.253976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226b0a5-5465-45ad-a284-8930ac69da80 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:50.260295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:50.261052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.261339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.261682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.281597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:50.284026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27335467-ba63-402e-adb0-267d96d075ac service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:50.295284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 929/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:50.376745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:50.378555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.462069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1b40-b903-4b3d-9bde-42d842e33f52 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:50.468931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:50.468931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.468931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.468931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] PATH_INFO: `/v3/users/b7c68fd25e8a49529aa7b617b5ea3a9a` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.470775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c68fd25e8a49529aa7b617b5ea3a9a)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:50.472746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:50.527215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c68fd25e8a49529aa7b617b5ea3a9a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.535219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c68fd25e8a49529aa7b617b5ea3a9a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.549373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c68fd25e8a49529aa7b617b5ea3a9a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.556672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c68fd25e8a49529aa7b617b5ea3a9a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.557668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c68fd25e8a49529aa7b617b5ea3a9a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.564740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 952/1881] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:50 2021] DELETE /identity/v3/users/b7c68fd25e8a49529aa7b617b5ea3a9a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:50.569520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.569811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.570087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.610582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:50.611836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.713064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 930/1882] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:50.731522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:50.733372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.803157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b54c8-baa6-40b9-a791-42a65c0d7738 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:50.804660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:50.805333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.806318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.806318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.819850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:50.821727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73d18-4bc4-401e-b22f-1270337a9f18 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:50.832482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 953/1883] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:50.844004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:50.845563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.857934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f13741-3e3d-4c6b-bcb2-ae3a6f42221c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:50.864984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:50.866014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.866295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.866639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] PATH_INFO: `/v3/users/29936dbcf1f54f428fe0bdf3d062f6fb` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.870849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29936dbcf1f54f428fe0bdf3d062f6fb)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:50.873156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:50.929860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29936dbcf1f54f428fe0bdf3d062f6fb'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.942518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29936dbcf1f54f428fe0bdf3d062f6fb'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.950631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29936dbcf1f54f428fe0bdf3d062f6fb'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.953493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29936dbcf1f54f428fe0bdf3d062f6fb'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.954520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29936dbcf1f54f428fe0bdf3d062f6fb'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:50.968988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 931/1884] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:50 2021] DELETE /identity/v3/users/29936dbcf1f54f428fe0bdf3d062f6fb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:50.973802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.973802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.974064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.998875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:51.000161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.064740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 954/1885] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:51.073615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.074663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.136110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008925e-b61c-4702-9087-eecb90a0ce91 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.140164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.140810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.141126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.141408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.152269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.153762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae1ef8-5239-470e-9ffe-6462926fa471 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.164838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 932/1886] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:51.234814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.236975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.251867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc6cb-69d2-49a1-bdbc-7630eea1ae86 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.259851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.264138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.265593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.265975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] PATH_INFO: `/v3/projects/135e5b8cc9604227843537808cf03e25` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.267667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=135e5b8cc9604227843537808cf03e25)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.281144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.357887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135e5b8cc9604227843537808cf03e25', 'request_id': 'req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.370602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135e5b8cc9604227843537808cf03e25', 'request_id': 'req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.378397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135e5b8cc9604227843537808cf03e25', 'request_id': 'req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.389114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] The token cache is being invalidate because project 135e5b8cc9604227843537808cf03e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:51.389422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.390113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.395992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 955/1887] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:51 2021] DELETE /identity/v3/projects/135e5b8cc9604227843537808cf03e25 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:51.398261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7d98-fe64-47fd-8860-f12032ab904e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.399890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7d98-fe64-47fd-8860-f12032ab904e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.400179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7d98-fe64-47fd-8860-f12032ab904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.423161 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-eace7d98-fe64-47fd-8860-f12032ab904e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:51.425197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-eace7d98-fe64-47fd-8860-f12032ab904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.527735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 933/1888] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:51.533924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.536161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.536326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.536718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.537035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.551743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d2ed-50ee-4b03-b184-368e8e6bba2f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.556195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:51.558287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.559173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.559444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.559763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] PATH_INFO: `/v3/projects/58293dc6b1aa4d258177fd45dec903fa` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.561093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58293dc6b1aa4d258177fd45dec903fa)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.563146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.570141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.581538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 934/1889] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:51.585507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.594932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee890ea0-19eb-4109-9c9c-8fa698397897 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.600539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.601413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.601764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.602140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.603036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:51.603416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.605048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.617963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 935/1890] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:51.621868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.632036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81c8f8-fa32-4161-b452-53203da26cb6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.634230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58293dc6b1aa4d258177fd45dec903fa', 'request_id': 'req-52771758-52e9-40fa-bca5-79f64418bb40'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.643780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58293dc6b1aa4d258177fd45dec903fa', 'request_id': 'req-52771758-52e9-40fa-bca5-79f64418bb40'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.653818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58293dc6b1aa4d258177fd45dec903fa', 'request_id': 'req-52771758-52e9-40fa-bca5-79f64418bb40'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.661016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] The token cache is being invalidate because project 58293dc6b1aa4d258177fd45dec903fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:51.661363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.662184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.663931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 956/1891] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:51 2021] DELETE /identity/v3/projects/58293dc6b1aa4d258177fd45dec903fa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:51.667998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.669708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.697084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.697747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.698029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.698305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.699010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.701072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.727798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 936/1892] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:51 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:51.732119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.732575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771758-52e9-40fa-bca5-79f64418bb40 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.733745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.791681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.794420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.794420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.794420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] PATH_INFO: `/v3/users/ac71628d16df4abaa4e9f0a6fc2590a8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.794731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac71628d16df4abaa4e9f0a6fc2590a8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.794811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2237d-1cf2-411f-94ee-e9cc96ae2a78 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.796623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.799940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.800606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.800903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.801215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.801916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.803818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.829809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 937/1893] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:51 2021] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:51.833815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.843941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c84b1-fba1-43e1-9dd0-f3512fbef736 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.849043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.849704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.849985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.850260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.850998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.851279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac71628d16df4abaa4e9f0a6fc2590a8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.852568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.859459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac71628d16df4abaa4e9f0a6fc2590a8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.866672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 938/1894] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:51.867698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.874235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac71628d16df4abaa4e9f0a6fc2590a8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.878079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d6b0-0e15-413f-9180-e716362e2113 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.881686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac71628d16df4abaa4e9f0a6fc2590a8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.882545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac71628d16df4abaa4e9f0a6fc2590a8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:51.882857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.883515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.883797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.884066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:51.884834 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:51.886513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1226a5-1ab0-489a-9f9f-dd35334f3972 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:51.888849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 957/1895] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:51 2021] DELETE /identity/v3/users/ac71628d16df4abaa4e9f0a6fc2590a8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:51.899558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 939/1896] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:51.903375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:51.904894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:51.983420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aed2-2080-49b5-b91a-6d1121c31d8e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:51.983420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:51.983614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:51.983799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:51.984219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] PATH_INFO: `/v3/projects/01b95e821f56442fae8a686036e60209/users/bd2c2f531eef45bd90b1c62615fda9c3/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.000440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b95e821f56442fae8a686036e60209, user_id=bd2c2f531eef45bd90b1c62615fda9c3, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.004768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.022903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 958/1897] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:51 2021] PUT /identity/v3/projects/01b95e821f56442fae8a686036e60209/users/bd2c2f531eef45bd90b1c62615fda9c3/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:52.038521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.038810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.039084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.080358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] MFA Rules not processed for user `bd2c2f531eef45bd90b1c62615fda9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:52.081984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:52.157605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 940/1898] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:52.167163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.172562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:52.232644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.234249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:52.241361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87110-831a-459f-86a2-102cab1ffb22 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.252752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.253846 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.254275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.254725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.264452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.266273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4e96b-07ce-4944-ae70-cabc11c6d6dd service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.277744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 959/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:52 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:52.338782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a5038-3015-4e00-b2ef-f9c80fd3d1ea None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.345762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.346772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.347433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.347716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] PATH_INFO: `/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.349422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a146e59c86044c1fb5fff9dcfc8dc080)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.351710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.415520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a146e59c86044c1fb5fff9dcfc8dc080', 'request_id': 'req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:52.425633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a146e59c86044c1fb5fff9dcfc8dc080', 'request_id': 'req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:52.432795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a146e59c86044c1fb5fff9dcfc8dc080', 'request_id': 'req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:52.452618 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] The token cache is being invalidate because project a146e59c86044c1fb5fff9dcfc8dc080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:52.452973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:52.453825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9ff20db8-74ca-41a5-b53e-9d2ab03e4f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:52.456887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 941/1900] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:52 2021] DELETE /identity/v3/projects/a146e59c86044c1fb5fff9dcfc8dc080 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:52.462487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.463242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.463242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.487659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:52.494291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:52.573638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 960/1901] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:52.579973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.580295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.580527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.601620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:52.603011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:52.627521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.630917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 942/1902] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:52.646102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612f92e-123b-4838-a8b0-a74aa7a37104 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.661725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.662631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.663082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.663268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.665786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:52.666147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.670141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.693062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 961/1903] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:52.697638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.708294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f37070-7655-489e-b2db-6a9341118e9f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.722024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.722861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.723327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.723716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.725052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.727053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.756170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 943/1904] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:52.760270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.770878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73802f5-e264-4549-900d-65e967f18b63 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.825166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.825838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.826119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.826389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.827098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.829099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.854873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 962/1905] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:52.856136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.867216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64023a29-b216-42b0-9193-d46a60d8cf5b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.872163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.872831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.873176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.873453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.874186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.875773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.886468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 944/1906] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:52.890316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.899944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70adf-8e39-43d1-b5d3-460ad52c1aad admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.904565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.905238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.905517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.905791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.906514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.908609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea35fa-021a-47bc-b829-c8506c40b5ab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.918140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 963/1907] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:52.922001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:52.932269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ceb4b-1849-41a4-8e25-c0037c79e8ab admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:52.936783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:52.937672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.937950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.938220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] PATH_INFO: `/v3/projects/80486fbbe3fe41d6b8bbb13937ae40ea/users/5008476f8e1743ffac96dd25af954f56/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:52.953616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80486fbbe3fe41d6b8bbb13937ae40ea, user_id=5008476f8e1743ffac96dd25af954f56, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:52.956504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:52.971051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 945/1908] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:52 2021] PUT /identity/v3/projects/80486fbbe3fe41d6b8bbb13937ae40ea/users/5008476f8e1743ffac96dd25af954f56/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:52.981994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:52.984072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:52.984444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.013275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] MFA Rules not processed for user `5008476f8e1743ffac96dd25af954f56`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:53.014092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:53.075404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 964/1909] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:52 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:53.079831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.140653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5430f1-fb1a-421c-b789-0572b38554f7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.145900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.146556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.146840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.147118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.147826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.149750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.174801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 946/1910] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:53 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:53.178851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.189204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2d498-3075-45fb-aa2b-698f6ca91f10 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.241279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.241976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.242506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.242506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.243215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.245302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.265473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 965/1911] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:53 2021] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:53:53.270020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.280155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064845-9d4f-4c34-90ba-18df9497d9c9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.285722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.286369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.286654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.286931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.287685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.289354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.299670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 947/1912] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:53.303710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.314242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369d45d-51ac-464b-99a6-cf9c2a374b31 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.319247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.320137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.320415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.320735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] PATH_INFO: `/v3/projects/192a8fa3ad354e03bcce84514471d83c/users/5ea9b7a4afff475593e86c5e743eb3ff/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.335658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=192a8fa3ad354e03bcce84514471d83c, user_id=5ea9b7a4afff475593e86c5e743eb3ff, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.338447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.354094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 966/1913] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:53 2021] PUT /identity/v3/projects/192a8fa3ad354e03bcce84514471d83c/users/5ea9b7a4afff475593e86c5e743eb3ff/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:53.364887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.374934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1e8-1af8-4d8f-9444-ba1b6a64886e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.431057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.431740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.432026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.432241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.433012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.434617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef9ec-0759-438b-b3f7-31f7602a22eb admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.445579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 948/1914] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:53 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:53.449664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.462226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23099-ecba-406d-b130-aac035407e3a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.467513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.468401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.468685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.469017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] PATH_INFO: `/v3/projects/192a8fa3ad354e03bcce84514471d83c/users/5ea9b7a4afff475593e86c5e743eb3ff/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.471665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=192a8fa3ad354e03bcce84514471d83c, user_id=5ea9b7a4afff475593e86c5e743eb3ff, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.474408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.485353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 967/1915] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:53 2021] PUT /identity/v3/projects/192a8fa3ad354e03bcce84514471d83c/users/5ea9b7a4afff475593e86c5e743eb3ff/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:53.495220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.495507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.495777 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.523251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] MFA Rules not processed for user `5ea9b7a4afff475593e86c5e743eb3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:53.524438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:53.588244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 949/1916] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:53 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:53.598030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:53.599755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:53.654033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7576-1d58-4838-ac30-372f15062801 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:53.657775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:53.658422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:53.658707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:53.659037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:53.669548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:53.671000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbaee1-aefd-4ad8-bf98-b9c59a02ff0c service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:53.680375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 968/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:53 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:54.240617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:54.311201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83fb1-e3eb-429d-a60a-0ab575698681 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:54.320987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:54.322113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:54.322475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:54.322765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] PATH_INFO: `/v3/users/5008476f8e1743ffac96dd25af954f56` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:54.324093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5008476f8e1743ffac96dd25af954f56)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:54.326147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:54.378051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5008476f8e1743ffac96dd25af954f56'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:54.391831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5008476f8e1743ffac96dd25af954f56'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:54.398926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5008476f8e1743ffac96dd25af954f56'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:54.399657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5008476f8e1743ffac96dd25af954f56'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:54.400262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5008476f8e1743ffac96dd25af954f56'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:54.414696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 950/1918] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:54 2021] DELETE /identity/v3/users/5008476f8e1743ffac96dd25af954f56 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:54.419456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:54.420133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:54.420332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:54.440060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:54.441330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:54.513655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 969/1919] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:54.526238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:54.529245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:54.606233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8212-d85e-4f9b-a893-8f96581d1152 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:54.610069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:54.611258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:54.611537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:54.611829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:54.629471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:54.631591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:54.645684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 951/1920] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:55.056853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:55.058409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:55.079327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b9a2-49f5-4667-872c-3e66a742965f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:55.088558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:55.089616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:55.089952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:55.090250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] PATH_INFO: `/v3/projects/80486fbbe3fe41d6b8bbb13937ae40ea` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:55.091546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80486fbbe3fe41d6b8bbb13937ae40ea)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:55.098592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:55.158274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80486fbbe3fe41d6b8bbb13937ae40ea', 'request_id': 'req-cd379868-68c4-420a-9c15-2f107527f2f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.167709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80486fbbe3fe41d6b8bbb13937ae40ea', 'request_id': 'req-cd379868-68c4-420a-9c15-2f107527f2f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.176227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80486fbbe3fe41d6b8bbb13937ae40ea', 'request_id': 'req-cd379868-68c4-420a-9c15-2f107527f2f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.187880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] The token cache is being invalidate because project 80486fbbe3fe41d6b8bbb13937ae40ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:55.188287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.189261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.191364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 970/1921] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:55 2021] DELETE /identity/v3/projects/80486fbbe3fe41d6b8bbb13937ae40ea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:55.195364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:55.204966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d3993-6def-4564-8b10-697860ac583d service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:55.272510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:55.273570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:55.273850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:55.274125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] PATH_INFO: `/v3/users/5ea9b7a4afff475593e86c5e743eb3ff` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:55.275342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea9b7a4afff475593e86c5e743eb3ff)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:55.277286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:55.325889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea9b7a4afff475593e86c5e743eb3ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.341186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea9b7a4afff475593e86c5e743eb3ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.349515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea9b7a4afff475593e86c5e743eb3ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.350384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea9b7a4afff475593e86c5e743eb3ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.351019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a505fb49-482c-45cc-a118-97ef00663da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea9b7a4afff475593e86c5e743eb3ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.366474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 952/1922] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:55 2021] DELETE /identity/v3/users/5ea9b7a4afff475593e86c5e743eb3ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:55.738052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:55.739856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:55.762652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379868-68c4-420a-9c15-2f107527f2f0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:55.831017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:55.831980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:55.832442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:55.832719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] PATH_INFO: `/v3/projects/192a8fa3ad354e03bcce84514471d83c` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:55.834033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=192a8fa3ad354e03bcce84514471d83c)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:55.836396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:55.887549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192a8fa3ad354e03bcce84514471d83c', 'request_id': 'req-127ab0cd-f2ae-41d8-bbbb-786f5a743016'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.895388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192a8fa3ad354e03bcce84514471d83c', 'request_id': 'req-127ab0cd-f2ae-41d8-bbbb-786f5a743016'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.901933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192a8fa3ad354e03bcce84514471d83c', 'request_id': 'req-127ab0cd-f2ae-41d8-bbbb-786f5a743016'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.912503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] The token cache is being invalidate because project 192a8fa3ad354e03bcce84514471d83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:55.912854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.913604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-127ab0cd-f2ae-41d8-bbbb-786f5a743016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:55.915373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 971/1923] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:55 2021] DELETE /identity/v3/projects/192a8fa3ad354e03bcce84514471d83c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:55.922248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:55.922669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:55.923012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:55.943416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:55.944710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.006898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 953/1924] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:56.015647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.015936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.016214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.035286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:56.036762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.045085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 972/1925] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:56.049494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.059714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de196de-a171-4f7b-9a72-55cddb483341 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.064915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.066063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.066342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.066616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.069333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:56.073446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.076980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.094945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 954/1926] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:56.099604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.110161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d0699-40ee-43d8-bbe4-dabe07463e4d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.116325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.117011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.117419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.117588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.118509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.124145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.210614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 973/1927] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:56 2021] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:56.211914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.232464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9666b0-c4ca-4fbb-8b05-63b8eaae8387 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.351826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.354125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.354654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.355138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.356081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.358338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.394108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 955/1928] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:56 2021] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:56.398584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.413150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756412-ed22-4a02-84f5-a8f81c6b6775 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.451450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.452558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.452840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.457236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.458314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.461541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.480220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 974/1929] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:56 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:56.487526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.502175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf13d8-1270-4a9f-ab5e-15c2a57a0e86 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.508289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.509224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.509505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.509830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.510545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.512112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3180d-fdd5-441f-9ea4-b4d85f0aec7e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.561978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 956/1930] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:56 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:56.562685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.580933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa21dee-8f3d-4056-914c-9655beb44c71 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.598893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.601286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.601725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.602260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] PATH_INFO: `/v3/projects/bbf2034cda644cc3b5d3dd005dc94660/users/5d145f3bc617424bbd0aaf79f835bd0d/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.622897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf2034cda644cc3b5d3dd005dc94660, user_id=5d145f3bc617424bbd0aaf79f835bd0d, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.625732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.688490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 975/1931] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:56 2021] PUT /identity/v3/projects/bbf2034cda644cc3b5d3dd005dc94660/users/5d145f3bc617424bbd0aaf79f835bd0d/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:56.699638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.699998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.700304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.729098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] MFA Rules not processed for user `5d145f3bc617424bbd0aaf79f835bd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:56.730306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.744858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.747269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.819100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 957/1932] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:56 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:56.843347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fff4a9-3482-4d83-b62c-b51be4859567 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.848979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.850016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.850136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.850400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.850688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] PATH_INFO: `/v3/users/bd2c2f531eef45bd90b1c62615fda9c3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.851400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.856659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2c2f531eef45bd90b1c62615fda9c3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.856659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.911566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2c2f531eef45bd90b1c62615fda9c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:56.919869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2c2f531eef45bd90b1c62615fda9c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:56.925829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ad75-5e48-43cc-9e85-ef7aa11a7fe3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:56.929831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:56.930550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.930833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.931110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.934415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2c2f531eef45bd90b1c62615fda9c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:56.940347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:56.941837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:56.942425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2c2f531eef45bd90b1c62615fda9c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:56.943529 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6ba7d364-0b0a-4f3e-8829-928f167fafd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2c2f531eef45bd90b1c62615fda9c3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:56.953039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 976/1933] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:56 2021] DELETE /identity/v3/users/bd2c2f531eef45bd90b1c62615fda9c3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:56.955782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:56.956761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:56.956761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:56.957011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 958/1934] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:56 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:56.970889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:56.975394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:56.976599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:56.982664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b475e-25e7-4449-a7c1-9b24ef36766e service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.049825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.050543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 977/1935] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:57.050871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.051056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.051285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] PATH_INFO: `/v3/users/5d145f3bc617424bbd0aaf79f835bd0d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.052508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d145f3bc617424bbd0aaf79f835bd0d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.057201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.062712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.065108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.133785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94eda-ccb6-49fa-832b-6febd144dfc1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.139935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.141110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.142094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.142375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.152480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.153973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2b37-182a-4ea7-8738-c5341ec64f35 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.165066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 978/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:57.239149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d145f3bc617424bbd0aaf79f835bd0d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.258525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d145f3bc617424bbd0aaf79f835bd0d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.267215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d145f3bc617424bbd0aaf79f835bd0d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.268307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d145f3bc617424bbd0aaf79f835bd0d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.269137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d145f3bc617424bbd0aaf79f835bd0d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.285183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 959/1937] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:56 2021] DELETE /identity/v3/users/5d145f3bc617424bbd0aaf79f835bd0d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:57.289345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.289730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.289999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.311458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:57.313160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.410318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 979/1938] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:57.426255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.428167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.500496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a7b3-65a6-4439-a920-50a83d357376 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.504880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.505728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.506006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.506276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.516642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.518467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbab674-e0c9-4717-b580-d48af62a359f service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.530741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 960/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:57.553858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.555614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.567895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a055a7-6fb6-4663-8eba-bbe6eccb3b9d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.573762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.574768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.575128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.575720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] PATH_INFO: `/v3/projects/01b95e821f56442fae8a686036e60209` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.578141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b95e821f56442fae8a686036e60209)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.580108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.644799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b95e821f56442fae8a686036e60209', 'request_id': 'req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.652800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b95e821f56442fae8a686036e60209', 'request_id': 'req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.661032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b95e821f56442fae8a686036e60209', 'request_id': 'req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.676561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] The token cache is being invalidate because project 01b95e821f56442fae8a686036e60209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:57.677029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.677819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d93b09b3-a10d-42b7-bd0f-15f917fabf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.679696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 980/1940] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:57 2021] DELETE /identity/v3/projects/01b95e821f56442fae8a686036e60209 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:57.685472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.686145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.686582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.708309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:57.709869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.799491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 961/1941] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:57.801439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.801925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.802022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.822487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:57.824120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.837676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 981/1942] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:57.841621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.855679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7405f-5d05-4dc8-bc8d-5ef312c5ad1a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.861563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.862588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.862771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.862909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.863733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:57.864041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.869213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.870026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.872151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:57.885969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 962/1943] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:53:57.894276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.904866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe28087-c5aa-45cd-b44d-aca227e6b2de admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.905422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada55da-ef0b-471f-b257-d3c13b05d2c7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:57.910624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.911407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.911764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.912587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:57.912721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.912983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.913282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:57.913643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:57.913985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] PATH_INFO: `/v3/projects/bbf2034cda644cc3b5d3dd005dc94660` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:57.915145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.915389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf2034cda644cc3b5d3dd005dc94660)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:57.917602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:57.958438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 963/1944] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:57 2021] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:57.963136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:57.980404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf2034cda644cc3b5d3dd005dc94660', 'request_id': 'req-d7b3da3b-c803-4792-8c5c-9985ad137ad1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.988800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf2034cda644cc3b5d3dd005dc94660', 'request_id': 'req-d7b3da3b-c803-4792-8c5c-9985ad137ad1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:57.995618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf2034cda644cc3b5d3dd005dc94660', 'request_id': 'req-d7b3da3b-c803-4792-8c5c-9985ad137ad1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:58.007813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] The token cache is being invalidate because project bbf2034cda644cc3b5d3dd005dc94660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:58.008099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:58.008741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d7b3da3b-c803-4792-8c5c-9985ad137ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:58.010572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 982/1945] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:57 2021] DELETE /identity/v3/projects/bbf2034cda644cc3b5d3dd005dc94660 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:58.016036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63f2-85b0-41f0-ab01-9e38a655f8a5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.016320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63f2-85b0-41f0-ab01-9e38a655f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.016664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf63f2-85b0-41f0-ab01-9e38a655f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.035749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-73bf63f2-85b0-41f0-ab01-9e38a655f8a5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:58.036990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-73bf63f2-85b0-41f0-ab01-9e38a655f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.040212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e143-1d42-4856-b003-b1158688de49 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.096550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 983/1946] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:58.097511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.098183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.098466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.098737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.099435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.101367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.104201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.104491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.104766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.121119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 964/1947] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:57 2021] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:58.123105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:58.124405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.125201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.127608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.133586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 984/1948] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:58.137230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.139133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e5f6a-bbe7-4c2a-9d4e-1d36f57c8ef6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.144382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.145080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.145361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.145631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.146358 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.146617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c441c48-e5fa-48b4-b8e5-36f560963cd0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.147975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.151333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.151979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.152290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.152575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.153350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:53:58.153664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.155246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.157903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 965/1949] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:58.161747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.170340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 985/1950] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:53:58.170968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef02bd-7c92-474c-b0e8-e172982a19b0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.171271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.175734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.176226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.176503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.176768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.177512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.179075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.181405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905fd2-87d8-4813-9392-99a0d9d7a10f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.186368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.187270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.187578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.187994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.189247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.189757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 966/1951] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:58.193049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.193872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.203046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676672f-0afc-4272-92ec-2e9992a65a42 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.208353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.209250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.209515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.209812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] PATH_INFO: `/v3/projects/6d8c136dd5664774bdce2f594a9fe8d3/users/08df3859b35a488e90ce4ecf4d8f0df1/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.219084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 986/1952] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:58.223329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.224567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8c136dd5664774bdce2f594a9fe8d3, user_id=08df3859b35a488e90ce4ecf4d8f0df1, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.227267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98954c-2437-4031-9734-c8b708a295bc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.240458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 967/1953] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:58 2021] PUT /identity/v3/projects/6d8c136dd5664774bdce2f594a9fe8d3/users/08df3859b35a488e90ce4ecf4d8f0df1/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:58.245640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.245932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.246208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.272570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:58.280177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.298932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1a24-6560-4b69-a816-11818e5985b5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.340964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 968/1954] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:58.350773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.352060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.354943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.355619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.355901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.356195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.356900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.358886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.390965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 987/1955] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:58.392088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.401497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455768e-7824-4676-a2ac-b63c08be6fa8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.406771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.407591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.407876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.408151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.408414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f9f5b-e0bd-4b52-9be5-e1f07850e8b9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.408908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.410837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.413112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.413793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.414073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.414348 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.427186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 988/1956] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:58.428607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.430224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.431034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.442317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d207-405c-4cb8-b037-bf76d61ec754 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.442955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 969/1957] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:58.447680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.448480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.448768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.449254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.449811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.451409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d685fb-afb0-456e-a580-e879c0d8bd86 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.462145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 989/1958] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:58.466119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.476463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79e9f-f9b7-424d-95fa-2c6c1a21a405 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.481203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.482080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.482359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.482624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] PATH_INFO: `/v3/projects/b475239870104ca0b8e545929e101683/users/6a5ae06562ab4d4780203e01dd94a15d/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.497763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b475239870104ca0b8e545929e101683, user_id=6a5ae06562ab4d4780203e01dd94a15d, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.500407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.514449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 970/1959] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:58 2021] PUT /identity/v3/projects/b475239870104ca0b8e545929e101683/users/6a5ae06562ab4d4780203e01dd94a15d/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:58.525295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.525583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.525862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.552482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] MFA Rules not processed for user `6a5ae06562ab4d4780203e01dd94a15d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:58.553720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:58.633865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 990/1960] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:58.637977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.715464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44f4bc-c097-4058-aa40-ac5226907178 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.721242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.721899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.722175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.722483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.723191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.725122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.762795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 971/1961] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:58.765742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.782026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970d80b-9124-49ac-ab1f-34cdd402048f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.841214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.842042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.842168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.842437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.843167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.845153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.866710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 991/1962] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:58.870622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.882092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b661a4-c8a4-4fbd-ac62-1341436ee127 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.886895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.887636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.887986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.888329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.889177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.890857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.902124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 972/1963] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:58.906096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.916066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4a5-c432-4676-952f-28d8bc4a40fa admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.920930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.921684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.922035 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.922375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.923251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.924996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a25082-cee8-4334-bf94-b4ad057236be admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.935319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 992/1964] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:58.939888 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:58.950813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7812ec-05df-4d94-b4bd-1cc5d604b51a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:58.956440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:58.957385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:58.957666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:58.958049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] PATH_INFO: `/v3/projects/ced55584e8a24969b206a3c1d1998270/users/a98245340ca14300a1543058204dba85/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:58.981216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced55584e8a24969b206a3c1d1998270, user_id=a98245340ca14300a1543058204dba85, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:58.981216 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:58.991121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 973/1965] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:58 2021] PUT /identity/v3/projects/ced55584e8a24969b206a3c1d1998270/users/a98245340ca14300a1543058204dba85/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:59.002052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d1d8-214f-49e4-ad58-6eec5a5037a2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.002342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d1d8-214f-49e4-ad58-6eec5a5037a2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.002621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d1d8-214f-49e4-ad58-6eec5a5037a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.029543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-7ee5d1d8-214f-49e4-ad58-6eec5a5037a2 None None] MFA Rules not processed for user `a98245340ca14300a1543058204dba85`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:59.030760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7ee5d1d8-214f-49e4-ad58-6eec5a5037a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:59.103708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 993/1966] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:58 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:59.107972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.113719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.114005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.114292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.146693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] MFA Rules not processed for user `08df3859b35a488e90ce4ecf4d8f0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:59.147824 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:59.183589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf316-8d14-4773-b994-502a089d5b20 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.192875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.194158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.194627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.195110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.196063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.198244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.217032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 994/1967] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:59 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:59.230313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.233255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:59.249651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 974/1968] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:53:59 2021] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:59.251734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.296190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93550e04-533d-449c-9ea0-bb87620373d3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.328251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea30974-6b90-40d3-a639-675b2ad7d447 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.333288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.334098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.334412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.334787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.335507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.337541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.353227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.353972 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.354319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.354734 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.362397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 975/1969] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:53:59 2021] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:53:59.363832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.373619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087734b-f0d8-4a00-b6e3-3c514542bfab admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.379104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.379793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.380077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.380355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.381184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.382795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.393435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 976/1970] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:53:59.397624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.407051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed176-b787-44c1-9608-25440e30923d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.411841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.412715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.412841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.413044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.413324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] PATH_INFO: `/v3/projects/7fcb95d061b849c38213a2e7626946eb/users/cb112c8a093b4d1f9ab67c4e8a4f70f0/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.414335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.424121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 995/1971] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:59 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:59.428691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcb95d061b849c38213a2e7626946eb, user_id=cb112c8a093b4d1f9ab67c4e8a4f70f0, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.431387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.446843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 977/1972] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:59 2021] PUT /identity/v3/projects/7fcb95d061b849c38213a2e7626946eb/users/cb112c8a093b4d1f9ab67c4e8a4f70f0/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:59.450741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.462668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc932-abaa-4c51-a25f-3e6d421b4ad1 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.523093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.523744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.524024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.524299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.525121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.526724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b9b66-85c0-4d5c-865e-aeddd4fa46f4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.536865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 996/1973] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:53:59 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:53:59.541526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.552312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25026854-fbd2-44b5-9f61-bc87aeb95613 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.557235 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.558110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.558391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.558662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] PATH_INFO: `/v3/projects/7fcb95d061b849c38213a2e7626946eb/users/cb112c8a093b4d1f9ab67c4e8a4f70f0/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.560620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcb95d061b849c38213a2e7626946eb, user_id=cb112c8a093b4d1f9ab67c4e8a4f70f0, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.563272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.574218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 978/1974] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:53:59 2021] PUT /identity/v3/projects/7fcb95d061b849c38213a2e7626946eb/users/cb112c8a093b4d1f9ab67c4e8a4f70f0/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:59.584354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d4d5-1112-4976-b4e0-ed8d2884fb0d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.584641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d4d5-1112-4976-b4e0-ed8d2884fb0d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.584916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268d4d5-1112-4976-b4e0-ed8d2884fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.611335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d268d4d5-1112-4976-b4e0-ed8d2884fb0d None None] MFA Rules not processed for user `cb112c8a093b4d1f9ab67c4e8a4f70f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:59.612548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d268d4d5-1112-4976-b4e0-ed8d2884fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:59.690280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 997/1975] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:53:59 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:59.701474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:59.703209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:59.764863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855cdb5-35ae-4243-bcd5-774aea460c0f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:59.768553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:59.769231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:59.769508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:59.769779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:59.825549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:59.826988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:59.838094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 979/1976] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:59 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:01.822036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:01.822585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:01.822861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:01.840635 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] MFA Rules not processed for user `08df3859b35a488e90ce4ecf4d8f0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:01.842135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:01.909100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 998/1977] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:01 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:02.711960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:02.718749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834357-555a-4d42-bbb8-583e825d3b30 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:02.723274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:02.724050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:02.724532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:02.725142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:02.801620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:02.803268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:02.817164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 980/1978] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:06.217895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:06.231000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a89ed-e58c-409b-b834-776ec863f6e2 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:06.237832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:06.238924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:06.240120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:06.240485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:06.254120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:06.256567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:06.268476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 999/1979] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:06 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:10.117450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.118897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.177041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.178446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.184791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4cd-560b-4bde-a865-c793dd33cfbf service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.191685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.192644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.192770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144b8d9-06b9-4362-a4a4-d046f4e2f98c service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.193101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.193368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] PATH_INFO: `/v3/users/48dfe81fcade4c3ba0f80b694c5a3c9e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.194809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48dfe81fcade4c3ba0f80b694c5a3c9e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.196932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.197841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.198698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.198977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.199249 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] PATH_INFO: `/v3/users/8a580093b1824f2aaaf84a72e9f8211d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.200455 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a580093b1824f2aaaf84a72e9f8211d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.202391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.243944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48dfe81fcade4c3ba0f80b694c5a3c9e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.248109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a580093b1824f2aaaf84a72e9f8211d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.256665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a580093b1824f2aaaf84a72e9f8211d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.257518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48dfe81fcade4c3ba0f80b694c5a3c9e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.264080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48dfe81fcade4c3ba0f80b694c5a3c9e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.264795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48dfe81fcade4c3ba0f80b694c5a3c9e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.265566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a4913d8e-29de-476f-a2de-b107762dac41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48dfe81fcade4c3ba0f80b694c5a3c9e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.272315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a580093b1824f2aaaf84a72e9f8211d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.281262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a580093b1824f2aaaf84a72e9f8211d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.282042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a580093b1824f2aaaf84a72e9f8211d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.283576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 981/1980] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/users/48dfe81fcade4c3ba0f80b694c5a3c9e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:10.289214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1000/1981] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/users/8a580093b1824f2aaaf84a72e9f8211d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:10.293849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.294232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.294634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.312313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:10.314279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.375311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 982/1982] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:10.386149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.387659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.391082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.392426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.404122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ddab-53e4-4bfa-bc40-af331193473b None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.411577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.412636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.413128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.413538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] PATH_INFO: `/v3/users/6a5ae06562ab4d4780203e01dd94a15d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.414942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5ae06562ab4d4780203e01dd94a15d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.416855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.451075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9491b2-18b6-4f0e-b80c-57e0003ab090 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.455482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.456144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.456449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.456711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.467729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.469629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.474700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5ae06562ab4d4780203e01dd94a15d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.481806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1001/1983] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:10.489512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5ae06562ab4d4780203e01dd94a15d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.496347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5ae06562ab4d4780203e01dd94a15d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.497160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5ae06562ab4d4780203e01dd94a15d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.497802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3ec12471-47aa-452d-a133-8a250af16fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5ae06562ab4d4780203e01dd94a15d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.498349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.499939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.513583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 983/1984] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/users/6a5ae06562ab4d4780203e01dd94a15d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:10.516055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b18b-32fd-4c03-9487-3c5056afc34b service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.517958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.518277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.518556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.537407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:10.538955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.585123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.586039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.586319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.586590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] PATH_INFO: `/v3/projects/c75c30f5593e4cc5b256a31f2942e371` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.587849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75c30f5593e4cc5b256a31f2942e371)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.589783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.610349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 984/1985] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:10.621268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.623091 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.646116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75c30f5593e4cc5b256a31f2942e371', 'request_id': 'req-e1debb11-19ef-4613-b064-917e50adb7f9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.658741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75c30f5593e4cc5b256a31f2942e371', 'request_id': 'req-e1debb11-19ef-4613-b064-917e50adb7f9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.668063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75c30f5593e4cc5b256a31f2942e371', 'request_id': 'req-e1debb11-19ef-4613-b064-917e50adb7f9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.679764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] The token cache is being invalidate because project c75c30f5593e4cc5b256a31f2942e371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:10.680062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.680755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.682729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1002/1986] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/projects/c75c30f5593e4cc5b256a31f2942e371 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:10.686638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.688296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.699941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412ae0-c7f8-463e-b353-a47245d6bef5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.752604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.753580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.753864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.754135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.755928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.763254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debb11-19ef-4613-b064-917e50adb7f9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.768827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.769752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.770178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.770357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] PATH_INFO: `/v3/users/5afad5c8a77a4072a1e038a3bcd713a3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.771300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.771620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afad5c8a77a4072a1e038a3bcd713a3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.773047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.773606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:10.783575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 985/1987] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:10.821209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afad5c8a77a4072a1e038a3bcd713a3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.829825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afad5c8a77a4072a1e038a3bcd713a3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.842930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afad5c8a77a4072a1e038a3bcd713a3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.850098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afad5c8a77a4072a1e038a3bcd713a3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.851717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afad5c8a77a4072a1e038a3bcd713a3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:10.858655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1003/1988] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/users/5afad5c8a77a4072a1e038a3bcd713a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:10.881032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:10.883083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:10.897973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d9347-b1b0-4978-a956-317a476a7728 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:10.963611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:10.964477 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:10.964761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:10.965062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] PATH_INFO: `/v3/projects/d16780cdab7f462daa83293ff0797475` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:10.966301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16780cdab7f462daa83293ff0797475)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:10.970309 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.055097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16780cdab7f462daa83293ff0797475', 'request_id': 'req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.073640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16780cdab7f462daa83293ff0797475', 'request_id': 'req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.088913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16780cdab7f462daa83293ff0797475', 'request_id': 'req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.125899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.127698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.132086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] The token cache is being invalidate because project d16780cdab7f462daa83293ff0797475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:11.132549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.143278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.143714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbd78-ab6e-4e44-bc76-109c83616723 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.145966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 986/1989] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:10 2021] DELETE /identity/v3/projects/d16780cdab7f462daa83293ff0797475 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:11.150566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.167829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.213712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.214588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.215153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.215153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] PATH_INFO: `/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.217311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa471dbc5b3b4301aaada0a5fe57e1f7)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.219260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.261467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90e12-d7a0-4d40-92d5-2e7c624a795a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.267550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa471dbc5b3b4301aaada0a5fe57e1f7', 'request_id': 'req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.274894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa471dbc5b3b4301aaada0a5fe57e1f7', 'request_id': 'req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.281385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa471dbc5b3b4301aaada0a5fe57e1f7', 'request_id': 'req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.291378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] The token cache is being invalidate because project aa471dbc5b3b4301aaada0a5fe57e1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:11.291665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.292358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.294150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1004/1990] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/projects/aa471dbc5b3b4301aaada0a5fe57e1f7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:11.294817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.296101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.318480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.319380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.319663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.319960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] PATH_INFO: `/v3/users/9ef612ac85554061bf80ea7f3c1b1164` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.321198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef612ac85554061bf80ea7f3c1b1164)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.323104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.358550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5470be-5aaa-4ec3-96d7-27c346b1d2f6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.363816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.364670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.364970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.365264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] PATH_INFO: `/v3/projects/b475239870104ca0b8e545929e101683` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.366453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b475239870104ca0b8e545929e101683)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.367483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef612ac85554061bf80ea7f3c1b1164'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.368348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.379560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef612ac85554061bf80ea7f3c1b1164'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.386158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef612ac85554061bf80ea7f3c1b1164'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.386853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef612ac85554061bf80ea7f3c1b1164'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.387508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b225ac15-7b58-496a-a774-cb1bfd734e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef612ac85554061bf80ea7f3c1b1164'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.401539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 987/1991] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/users/9ef612ac85554061bf80ea7f3c1b1164 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:11.403040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d638-f49b-4b80-b922-37cd6563eace None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.403455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d638-f49b-4b80-b922-37cd6563eace None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.403825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d638-f49b-4b80-b922-37cd6563eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.415391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b475239870104ca0b8e545929e101683', 'request_id': 'req-ef995c64-995f-4157-ad95-0a7d85b27f2b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.424651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b475239870104ca0b8e545929e101683', 'request_id': 'req-ef995c64-995f-4157-ad95-0a7d85b27f2b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.431205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b475239870104ca0b8e545929e101683', 'request_id': 'req-ef995c64-995f-4157-ad95-0a7d85b27f2b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.432113 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f4b8d638-f49b-4b80-b922-37cd6563eace None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:11.433390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f4b8d638-f49b-4b80-b922-37cd6563eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.442414 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] The token cache is being invalidate because project b475239870104ca0b8e545929e101683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:11.442786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.444058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.446350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1005/1992] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/projects/b475239870104ca0b8e545929e101683 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:11.450050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.451421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.501814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 988/1993] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:11.510260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.510602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.510878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.523022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef995c64-995f-4157-ad95-0a7d85b27f2b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.527926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.528979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.529474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.529715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] PATH_INFO: `/v3/users/a98245340ca14300a1543058204dba85` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.530975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:11.531110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98245340ca14300a1543058204dba85)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.532986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.533657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.545667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 989/1994] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:11.548640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.558040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34932f3-952f-41af-ba15-9e4f30946cf2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.565674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.566431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.566917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.567273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.568393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:11.568831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.571429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.585237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 990/1995] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:11.589707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.592627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98245340ca14300a1543058204dba85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.601017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03915-a46a-4e47-8f37-ad9b66589359 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.603411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98245340ca14300a1543058204dba85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.607010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.607674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.607958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.608236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.608965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.611635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.618285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98245340ca14300a1543058204dba85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.625731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98245340ca14300a1543058204dba85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.627092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98245340ca14300a1543058204dba85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.634312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1006/1996] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/users/a98245340ca14300a1543058204dba85 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:11.639830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 991/1997] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:11 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:11.644086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.645831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.708180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbd549-ac94-4be8-814c-30d294636f18 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.748911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.752978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.777929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.778690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.778885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.779183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.779876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.782212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.809239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1007/1998] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:11 2021] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:11.815379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.826500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ba363-a71e-4c60-b1b4-19cf96ed98fb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.838957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.840737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.841711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.842569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.843392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.845865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.855804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b83ca9-fa7a-499e-a9ec-6538552450b6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.857257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1008/1999] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:11 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:11.861786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.864484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.865396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.865670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.865976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] PATH_INFO: `/v3/projects/f833289cad3045a599304101318a71f0` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.867228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f833289cad3045a599304101318a71f0)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.869417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.872157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124004ab-9bd8-4f1f-b869-967579f4589f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.877994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.878775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.879136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.879480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:11.880298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:11.882007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:11.894089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1009/2000] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:11.898190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.908749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3926-7c20-46f8-ba1f-87827eea5765 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:11.923111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f833289cad3045a599304101318a71f0', 'request_id': 'req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.929561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f833289cad3045a599304101318a71f0', 'request_id': 'req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.936644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f833289cad3045a599304101318a71f0', 'request_id': 'req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.958265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] The token cache is being invalidate because project f833289cad3045a599304101318a71f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:11.958562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.961428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:11.968052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 992/2001] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/projects/f833289cad3045a599304101318a71f0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:11.969041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:11.970960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:11.986118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:11.987086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:11.987375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:11.987732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] PATH_INFO: `/v3/projects/0cfd34669b024b05945786f9b331d29d/users/9fd9d69a9cc1454facb22e3b7032ff54/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.006308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfd34669b024b05945786f9b331d29d, user_id=9fd9d69a9cc1454facb22e3b7032ff54, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.009800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1b595-09fb-4ba5-b487-43daa41d4cd8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.027785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1010/2002] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:11 2021] PUT /identity/v3/projects/0cfd34669b024b05945786f9b331d29d/users/9fd9d69a9cc1454facb22e3b7032ff54/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:12.029225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f8c5-4332-4c0c-8b0e-d927dda8388f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.029518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f8c5-4332-4c0c-8b0e-d927dda8388f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.029792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f8c5-4332-4c0c-8b0e-d927dda8388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.057638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890d8e0-6ce7-4321-86e3-dd64e25c40e4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.059229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bc15f8c5-4332-4c0c-8b0e-d927dda8388f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:12.061077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bc15f8c5-4332-4c0c-8b0e-d927dda8388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.144922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.146586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.146867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.147196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] PATH_INFO: `/v3/projects/ced55584e8a24969b206a3c1d1998270` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.150823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced55584e8a24969b206a3c1d1998270)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.154108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.179627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1011/2003] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:12.179627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.179627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.179627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.223757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced55584e8a24969b206a3c1d1998270', 'request_id': 'req-7a1de024-0919-427f-9fca-51265b3b1b35'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.225721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] MFA Rules not processed for user `9fd9d69a9cc1454facb22e3b7032ff54`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:12.227470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.230213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced55584e8a24969b206a3c1d1998270', 'request_id': 'req-7a1de024-0919-427f-9fca-51265b3b1b35'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.237230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced55584e8a24969b206a3c1d1998270', 'request_id': 'req-7a1de024-0919-427f-9fca-51265b3b1b35'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.270315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] The token cache is being invalidate because project ced55584e8a24969b206a3c1d1998270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:12.270608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.271288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a1de024-0919-427f-9fca-51265b3b1b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.273131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 993/2004] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:11 2021] DELETE /identity/v3/projects/ced55584e8a24969b206a3c1d1998270 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:12.274391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.274673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.274948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.294303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:12.295545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.314386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1012/2005] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:12.315245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.316552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.374298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 994/2006] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:12.375231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.376830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.401027 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548317a2-1420-4e80-afda-dbba125612b4 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.411763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.412721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.413028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.413312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] PATH_INFO: `/v3/users/cb112c8a093b4d1f9ab67c4e8a4f70f0` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.414641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb112c8a093b4d1f9ab67c4e8a4f70f0)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.416672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.441056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b750f6-619c-436a-89c4-febc4ea7de81 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.445619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.449669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.449920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.450264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.459969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.461502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.475274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 995/2007] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:12 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:12.476047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.477006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb112c8a093b4d1f9ab67c4e8a4f70f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.486837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb112c8a093b4d1f9ab67c4e8a4f70f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.487058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d0e1-1eeb-478d-ada7-24454fa5ccf9 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.492606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.493300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.493575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.493844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.494575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:12.494885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.496473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.501559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb112c8a093b4d1f9ab67c4e8a4f70f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.513004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 996/2008] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:12.513274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb112c8a093b4d1f9ab67c4e8a4f70f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.513274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb112c8a093b4d1f9ab67c4e8a4f70f0'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.513787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.516317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.521731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1013/2009] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:12 2021] DELETE /identity/v3/users/cb112c8a093b4d1f9ab67c4e8a4f70f0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:12.529965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacfce-88ac-4e9f-9b47-49ebf1445da5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.607300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.608068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.608356 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.608748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.609590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.612253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.642217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 997/2010] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:12.646518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.658557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a15be-dfa9-440c-8f19-9bda0d685366 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.718694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.720013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.720365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.720720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.722087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.724472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.753809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1014/2011] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:12.757540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.769289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605e22-3317-4623-8f9a-647a85430e5d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.774956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.776011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.776290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.776619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.777589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.779688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.796542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 998/2012] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:12.798782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.810405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4e2d-6805-4b53-9643-0dad02475e86 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.823488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.824585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.825175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.825604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.826359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.828081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.842161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1015/2013] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:12 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:12.847392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.855091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:12.857677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.857803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c4033-739e-4869-8347-25df4d3af150 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.863194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.864088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.864364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.864635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] PATH_INFO: `/v3/projects/87562b49d04549c0b88b9146be8c0ad1/users/4e9703dafe594a8a84f4f1ef27606bc3/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.873909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1eaec-b822-4dfa-8826-d2e85ed6de1c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:12.884212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87562b49d04549c0b88b9146be8c0ad1, user_id=4e9703dafe594a8a84f4f1ef27606bc3, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.885394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:12.886366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.886746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.887123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] PATH_INFO: `/v3/projects/7fcb95d061b849c38213a2e7626946eb` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.887234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bac28-edeb-4201-9a17-7f7df0b10209 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.889353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcb95d061b849c38213a2e7626946eb)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:12.892168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:12.905940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 999/2014] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:12 2021] PUT /identity/v3/projects/87562b49d04549c0b88b9146be8c0ad1/users/4e9703dafe594a8a84f4f1ef27606bc3/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:12.920024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.920513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.920852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:12.949607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] MFA Rules not processed for user `4e9703dafe594a8a84f4f1ef27606bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:12.950053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcb95d061b849c38213a2e7626946eb', 'request_id': 'req-006d4fbc-c601-4a43-b2ce-40b62e1693f7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.951037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:12.957910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcb95d061b849c38213a2e7626946eb', 'request_id': 'req-006d4fbc-c601-4a43-b2ce-40b62e1693f7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.964821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcb95d061b849c38213a2e7626946eb', 'request_id': 'req-006d4fbc-c601-4a43-b2ce-40b62e1693f7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.975839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] The token cache is being invalidate because project 7fcb95d061b849c38213a2e7626946eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:12.976119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.976788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-006d4fbc-c601-4a43-b2ce-40b62e1693f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:12.978488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1016/2015] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:12 2021] DELETE /identity/v3/projects/7fcb95d061b849c38213a2e7626946eb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:12.983886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795ec8-18a3-466d-af85-3ef4a2d119e5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:12.984163 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795ec8-18a3-466d-af85-3ef4a2d119e5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:12.984436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb795ec8-18a3-466d-af85-3ef4a2d119e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.002804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cb795ec8-18a3-466d-af85-3ef4a2d119e5 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:13.003932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cb795ec8-18a3-466d-af85-3ef4a2d119e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.020103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1000/2016] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:13.024581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.026064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.061040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1017/2017] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:13.069493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.069778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.070053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.086920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4863a6-26a9-49c0-b324-716da70513ba None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.088028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:13.089239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.091469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.092117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.092394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.092658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.093389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.095283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.097051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1018/2018] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:13.101092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.109974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63204d21-1e8d-4d53-9f3f-d648b69aad02 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.114818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.115527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.115865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.116164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.117001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:13.117306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.118888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.128177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1001/2019] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:13.129689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.134598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1019/2020] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:54:13.135678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.146259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd42b1-92f0-47b8-84aa-746ddb092798 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.198616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcf6b1-7985-4940-8150-127648597f51 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.213093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.213791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.214060 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.214513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.215227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.217173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.223202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.223907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.224191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.226471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.227344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.231253 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.256180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1020/2021] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:13.260149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.272997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1002/2022] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:13.277070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.289509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d226a-a4e3-4f36-9c21-e92ea9f6b52c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.358385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3ec6-017d-4a2c-8595-27bf5e62d9d6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.361308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.362236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.362526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.362803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.363549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.365353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.365640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.366606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.367292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.367715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.368592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.370917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.377293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1003/2023] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:13.382390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.394248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77aad6-4844-41ad-80e7-83522d360a6e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.399578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.400012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1021/2024] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:13.400816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.401145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.401406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.402149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.403906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.404061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.415317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1004/2025] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:13.416563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0e04-b345-4691-af4a-5a8110b79ead admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.419731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.423544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.424625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.425033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.425302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.426126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.427879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.432237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9635e-d84e-4ea8-9523-6e8faf0795d2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.438996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.440094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.440577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1022/2026] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:13.441269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.441616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] PATH_INFO: `/v3/projects/7b649987d6af449288c15228a39aecd4/users/333c7f06a54b41b7b7823d76edf5a47e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.444432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.455210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bad9e-85cf-4f58-9728-c8d19be7b6a6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.460454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.461201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b649987d6af449288c15228a39aecd4, user_id=333c7f06a54b41b7b7823d76edf5a47e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.461329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.461689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.462024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.462834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.464628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.464907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e14f96-9bfc-4b4f-93b3-1319ef7a6763 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.479268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1023/2027] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:13.483463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.485561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1005/2028] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:13 2021] PUT /identity/v3/projects/7b649987d6af449288c15228a39aecd4/users/333c7f06a54b41b7b7823d76edf5a47e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:13.495127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9808b-bae1-49b2-8b17-d5d8f53b7aa7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.495822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.496109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.496697 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.525852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] MFA Rules not processed for user `333c7f06a54b41b7b7823d76edf5a47e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:13.527146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.579634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.580531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.580815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.581119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] PATH_INFO: `/v3/projects/9b038c5e3f0c4418b4594906e0cbf144/users/38b368241911478ab58ebce3318c4153/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.595471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b038c5e3f0c4418b4594906e0cbf144, user_id=38b368241911478ab58ebce3318c4153, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.598374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640633d2-a05b-43dc-ad0a-653b18b24fbb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.601053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1006/2029] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:13.605556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.611731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1024/2030] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:13 2021] PUT /identity/v3/projects/9b038c5e3f0c4418b4594906e0cbf144/users/38b368241911478ab58ebce3318c4153/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:13.616334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a850b-0182-4266-bf7f-1af82256a0fd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.622906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.623193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.623467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.649898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] MFA Rules not processed for user `38b368241911478ab58ebce3318c4153`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:13.651118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.671821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.673040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.673312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.673586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.674293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.676184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.702008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1007/2031] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:13.706241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.714191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1025/2032] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:13.725743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.727133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.770415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee4cd-9263-46a7-96c1-d81c35297b7c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.775649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.776469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.776764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.777266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.778076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.780005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.781281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d55e6-248e-4b2f-8e3c-6e20a6f93ee7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.800370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1008/2033] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:13.804298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.815169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff7930-67c8-4b7b-99f3-01b8dddc5ef8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.820692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.821400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.821680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.821955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.822690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.824292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.832536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.833345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.833839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.834202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.835365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1009/2034] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:13.839640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.861115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966ecb0-d8f2-4dd7-9228-2794ddd1aeb8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.861115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.861115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.861115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.861508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] PATH_INFO: `/v3/projects/6f24a41a46f74a0887446762eae3171b/users/ed96d56e95d84a0e88cf95fdc6f3439b/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.872911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f24a41a46f74a0887446762eae3171b, user_id=ed96d56e95d84a0e88cf95fdc6f3439b, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.878894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b734a34-d1ab-41f5-93fd-343bdd2184f2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.895071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1010/2035] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:13 2021] PUT /identity/v3/projects/6f24a41a46f74a0887446762eae3171b/users/ed96d56e95d84a0e88cf95fdc6f3439b/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:13.896592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.897246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.897532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.898006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.898313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:13.910514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1026/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:13.911771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:13.916798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] MFA Rules not processed for user `9fd9d69a9cc1454facb22e3b7032ff54`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:13.918191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:13.931967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7f1b7-6509-485a-8edd-802b351dbd24 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:13.981472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1011/2037] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:13.994033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:13.994759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:13.995040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:13.995315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:13.996082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:13.997722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa9191-4b32-4792-af77-456892584643 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:14.007998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1027/2038] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:13 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:14.012311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:14.023816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd482ef-28cf-4967-a0b3-1fdae821a8f1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:14.042909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:14.046592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:14.046947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:14.047381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] PATH_INFO: `/v3/projects/6f24a41a46f74a0887446762eae3171b/users/ed96d56e95d84a0e88cf95fdc6f3439b/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:14.050869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f24a41a46f74a0887446762eae3171b, user_id=ed96d56e95d84a0e88cf95fdc6f3439b, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:14.053765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:14.070736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1012/2039] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:14 2021] PUT /identity/v3/projects/6f24a41a46f74a0887446762eae3171b/users/ed96d56e95d84a0e88cf95fdc6f3439b/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:14.081041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:14.081654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:14.082154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:14.122033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] MFA Rules not processed for user `ed96d56e95d84a0e88cf95fdc6f3439b`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:14.125137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:14.241459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1028/2040] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:14 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:14.257259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:14.364732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc4bad-8d95-4f56-977f-5ce24254228a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:14.371671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:14.372438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:14.372723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:14.373436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:14.415580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:14.417779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:14.440460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1013/2041] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:14 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:15.132312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:15.142317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f786-418d-48df-a5ed-e696061a59a0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:15.145924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:15.146560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:15.146841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:15.147111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:15.211798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:15.213309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce2473-6aff-413e-b9d0-cdf3ea9dd50a service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:15.226320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1029/2042] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:15 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:15.989270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:15.996391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.077903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37900e-56c9-478a-ab22-c17c32132b5b service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:16.086447 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:16.088283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.088550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.088828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] PATH_INFO: `/v3/users/4c7b6c21dda54880b2ab1f00c2c2eca0` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.090181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7b6c21dda54880b2ab1f00c2c2eca0)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:16.092213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:16.146479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7b6c21dda54880b2ab1f00c2c2eca0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.158529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7b6c21dda54880b2ab1f00c2c2eca0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.165906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7b6c21dda54880b2ab1f00c2c2eca0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.166620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7b6c21dda54880b2ab1f00c2c2eca0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.167259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7b6c21dda54880b2ab1f00c2c2eca0'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.181549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1014/2043] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:15 2021] DELETE /identity/v3/users/4c7b6c21dda54880b2ab1f00c2c2eca0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:16.185825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.186317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.186510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.203639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:16.204824 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.263699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1030/2044] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:16.273922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:16.275329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.341945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96c22a-a7ba-42da-af6a-0bd275399a94 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:16.346437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:16.347092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.347376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.347654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.357893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:16.359517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:16.376746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1015/2045] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:16.706003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:16.708966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.721148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81664f0-b168-4364-88ec-310bd1e0c965 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:16.727280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:16.728154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.728437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.728714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] PATH_INFO: `/v3/users/38b368241911478ab58ebce3318c4153` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.730332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b368241911478ab58ebce3318c4153)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:16.732287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:16.804441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b368241911478ab58ebce3318c4153'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.822090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:16.822853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b368241911478ab58ebce3318c4153'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.823966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.846240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b368241911478ab58ebce3318c4153'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.849933 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343b5-49a0-47e5-b97f-56725399a0d0 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:16.854472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b368241911478ab58ebce3318c4153'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.855192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-67fd8b5e-c6a5-40d6-a30c-7569b8c6d6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b368241911478ab58ebce3318c4153'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.862785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:16.863838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1031/2046] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:16 2021] DELETE /identity/v3/users/38b368241911478ab58ebce3318c4153 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:16.866914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.867265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.867628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] PATH_INFO: `/v3/projects/42b4caab9d264f53adf55d0aeea7240a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.869085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b4caab9d264f53adf55d0aeea7240a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:16.869955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfba7ac-7d0f-49db-87bb-38fe04e86526 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:16.871179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:16.881348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfba7ac-7d0f-49db-87bb-38fe04e86526 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:16.882543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfba7ac-7d0f-49db-87bb-38fe04e86526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:16.919747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3bfba7ac-7d0f-49db-87bb-38fe04e86526 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:16.922779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3bfba7ac-7d0f-49db-87bb-38fe04e86526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:16.952178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b4caab9d264f53adf55d0aeea7240a', 'request_id': 'req-e84211d3-c7f8-48dc-9046-d7f7fd732b64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.961207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b4caab9d264f53adf55d0aeea7240a', 'request_id': 'req-e84211d3-c7f8-48dc-9046-d7f7fd732b64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.970405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b4caab9d264f53adf55d0aeea7240a', 'request_id': 'req-e84211d3-c7f8-48dc-9046-d7f7fd732b64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.991321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] The token cache is being invalidate because project 42b4caab9d264f53adf55d0aeea7240a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:16.991975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:16.992297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e84211d3-c7f8-48dc-9046-d7f7fd732b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:17.003291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1016/2047] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:16 2021] DELETE /identity/v3/projects/42b4caab9d264f53adf55d0aeea7240a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:17.007039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.007531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.007988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.048592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:17.051691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.153046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1032/2048] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:17.156345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1017/2049] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:17.166547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.169613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.170023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.180458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.181461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.189862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:17.191259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.201404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1033/2050] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:17.205790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.217988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba4b5-3360-4b89-b322-662fb483c31b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.230345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955591-2258-4851-8317-25396375622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.231142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955591-2258-4851-8317-25396375622c admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.231490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955591-2258-4851-8317-25396375622c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.231858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955591-2258-4851-8317-25396375622c admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.232686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955591-2258-4851-8317-25396375622c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:17.233238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955591-2258-4851-8317-25396375622c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.235289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955591-2258-4851-8317-25396375622c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.253123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1034/2051] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:54:17.255601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955591-2258-4851-8317-25396375622c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.267715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955591-2258-4851-8317-25396375622c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.274443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.276653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.277145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.277604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.278597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.280984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.294288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b050b9-9eff-4faa-a07c-0ef99148ebb1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.298807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.299702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.299969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.300783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.316975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1035/2052] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:17 2021] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:17.319416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.321486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.322383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.334186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1018/2053] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:17.403403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bf842-a96a-4d85-aece-3e7680174c97 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.410578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.411491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.412861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.413345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.414222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.417463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.444028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1036/2054] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:17 2021] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:17.452233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.466536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495ba9-a38f-4423-a68a-6629fba6cad8 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.473641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.474720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.475078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.475758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.476504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.478141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.493244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1019/2055] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:17.497003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.508175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1f35e-2ab8-47f2-90ab-a35e94716c62 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.514186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.514942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.515463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.516077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.517261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.519343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ecf1-5ac3-4e5e-a0d1-3b1cc9f70ff0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.531369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1037/2056] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:17.537694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.556813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d9373-a430-4adb-b2e9-0e860b5e99db admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.564474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.565654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.565999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.566780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] PATH_INFO: `/v3/projects/ff725c599a374605a9ea87eef7228518/users/917c7eddbb2b4078a110f7c91491f013/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.586283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff725c599a374605a9ea87eef7228518, user_id=917c7eddbb2b4078a110f7c91491f013, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.589271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.617004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1020/2057] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:17 2021] PUT /identity/v3/projects/ff725c599a374605a9ea87eef7228518/users/917c7eddbb2b4078a110f7c91491f013/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:17.619362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.619648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.620015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.655720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] MFA Rules not processed for user `917c7eddbb2b4078a110f7c91491f013`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:17.657782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.716017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.717823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.759165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1038/2058] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:17 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:17.779937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:17.781667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:17.856574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4bab-3447-4873-aa50-02ff18fae0f0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.863837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.865721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.866003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.866278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] PATH_INFO: `/v3/projects/9b038c5e3f0c4418b4594906e0cbf144` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.870292 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b038c5e3f0c4418b4594906e0cbf144)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.873803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.876437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c06d-d118-4d39-af65-0a316b53e5dc None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:17.882229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:17.883832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:17.887867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:17.888339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:17.898433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:17.900627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bad00-63f7-4171-b030-fb68189cab89 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:17.914750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1039/2059] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:17 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:17.974387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b038c5e3f0c4418b4594906e0cbf144', 'request_id': 'req-577c701c-883f-4976-8abe-5bd677236ee4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:17.981436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b038c5e3f0c4418b4594906e0cbf144', 'request_id': 'req-577c701c-883f-4976-8abe-5bd677236ee4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:17.989866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b038c5e3f0c4418b4594906e0cbf144', 'request_id': 'req-577c701c-883f-4976-8abe-5bd677236ee4'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:18.011625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] The token cache is being invalidate because project 9b038c5e3f0c4418b4594906e0cbf144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:18.013433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:18.014227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-577c701c-883f-4976-8abe-5bd677236ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:18.016585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1021/2060] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:17 2021] DELETE /identity/v3/projects/9b038c5e3f0c4418b4594906e0cbf144 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:18.022288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a0e61-9652-4503-b569-2280cc153101 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.022789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a0e61-9652-4503-b569-2280cc153101 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.022866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a0e61-9652-4503-b569-2280cc153101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.052124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-669a0e61-9652-4503-b569-2280cc153101 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:18.054349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-669a0e61-9652-4503-b569-2280cc153101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:18.155193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1040/2061] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:18.163508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.163837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.164061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.204450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:18.214472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:18.245602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1022/2062] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:18.248709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a0e61-9652-4503-b569-2280cc153101 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.277858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a0e61-9652-4503-b569-2280cc153101 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.294653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.302706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.303354 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.303914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.310047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:18.312277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.317434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.362184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1041/2063] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:18.366766 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.390691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedf59-e8e2-4ae1-9838-f1512e67f904 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.401636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.402988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.403512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.403999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.405261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.408335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.481723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1023/2064] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:18 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:18.486490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.500499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf081-d1b8-4107-a087-fa8fe3a44cbb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.617008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.618373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.618820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.619452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.620373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.623184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.657868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1042/2065] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:18 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:18.662266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.675726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becfd4e-7566-4848-b5f9-32a6433f8423 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.682184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.683011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.683393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.683919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.687271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.688072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.706476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1024/2066] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:18 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:18.707845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.725659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ce22-01b7-4fda-92ca-d1a1c02635a4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.732361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.733080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.733569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.733747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.734496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.737440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf16ab-7a9c-4ff3-b6fa-b8c3a924e24d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.750288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1043/2067] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:18 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:18.754528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.765149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e477-5219-4d9b-bc0e-982c6267b79b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:18.771907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:18.773109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.773385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.773695 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] PATH_INFO: `/v3/projects/faae26ffde604c639f773be505ece9a4/users/51328fc8d387442e99171c0299fdc41e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.789615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faae26ffde604c639f773be505ece9a4, user_id=51328fc8d387442e99171c0299fdc41e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:18.792234 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:18.807087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1025/2068] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:18 2021] PUT /identity/v3/projects/faae26ffde604c639f773be505ece9a4/users/51328fc8d387442e99171c0299fdc41e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:18.817221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:18.817513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:18.817786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:18.847382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] MFA Rules not processed for user `51328fc8d387442e99171c0299fdc41e`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:18.848599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:18.917125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1044/2069] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:18 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:18.930102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:18.932152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:18.998711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a87758-e4a8-48ac-b2c2-471973fc8084 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.003427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.004134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.004417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.004703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.014020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:19.015470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:19.031660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1026/2070] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:18 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:19.969256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.978937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3161768-55b4-46a3-8272-3e32107f43ac None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.983240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.983817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.984102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.984377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.986263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:20.049437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.050890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6cf02-e19b-4f47-8c69-c2c72827ea88 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.060553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1045/2071] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:19 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:24.195983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:24.197423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:24.264665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90681-ff6c-4e75-b83d-00391915bea0 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:24.269867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:24.270724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:24.271033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:24.271303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] PATH_INFO: `/v3/users/4e9703dafe594a8a84f4f1ef27606bc3` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:24.272768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9703dafe594a8a84f4f1ef27606bc3)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:24.274708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:24.329955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9703dafe594a8a84f4f1ef27606bc3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.342325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9703dafe594a8a84f4f1ef27606bc3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.349315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9703dafe594a8a84f4f1ef27606bc3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.350122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9703dafe594a8a84f4f1ef27606bc3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.350641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9703dafe594a8a84f4f1ef27606bc3'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.363029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1027/2072] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:24 2021] DELETE /identity/v3/users/4e9703dafe594a8a84f4f1ef27606bc3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:24.367604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:24.368085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:24.368205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:24.385761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:24.386931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:24.442292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1046/2073] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:24.452180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:24.454268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:24.515277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55acfd4-1e4c-4b4c-87aa-a2b2783715d9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:24.519612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:24.520251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:24.520536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:24.520813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:24.529831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:24.531249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:24.541049 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1028/2074] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:24.808017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:24.809540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:24.821562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c759f-c7a5-470c-9f86-a9082383c359 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:24.826208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:24.827150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:24.827496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:24.827837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] PATH_INFO: `/v3/projects/87562b49d04549c0b88b9146be8c0ad1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:24.829927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87562b49d04549c0b88b9146be8c0ad1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:24.831912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:24.878842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87562b49d04549c0b88b9146be8c0ad1', 'request_id': 'req-d420f151-cd57-42f7-ab5a-d667a254f3a7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.885205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87562b49d04549c0b88b9146be8c0ad1', 'request_id': 'req-d420f151-cd57-42f7-ab5a-d667a254f3a7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.891170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87562b49d04549c0b88b9146be8c0ad1', 'request_id': 'req-d420f151-cd57-42f7-ab5a-d667a254f3a7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.900934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] The token cache is being invalidate because project 87562b49d04549c0b88b9146be8c0ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:24.901255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.901911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:24.903559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1047/2075] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:24 2021] DELETE /identity/v3/projects/87562b49d04549c0b88b9146be8c0ad1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:24.907637 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:24.917088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf2c7-7866-44ed-af69-f548507ad8cc service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:24.970260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:24.971109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:24.971383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:24.971649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] PATH_INFO: `/v3/users/333c7f06a54b41b7b7823d76edf5a47e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:24.972825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333c7f06a54b41b7b7823d76edf5a47e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:24.974749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:25.021395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333c7f06a54b41b7b7823d76edf5a47e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.032702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333c7f06a54b41b7b7823d76edf5a47e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.039779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333c7f06a54b41b7b7823d76edf5a47e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.040469 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333c7f06a54b41b7b7823d76edf5a47e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.041095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333c7f06a54b41b7b7823d76edf5a47e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.053117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1029/2076] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:24 2021] DELETE /identity/v3/users/333c7f06a54b41b7b7823d76edf5a47e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:25.314896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:25.316372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:25.332126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f151-cd57-42f7-ab5a-d667a254f3a7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:25.386695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:25.387551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:25.387838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:25.388109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] PATH_INFO: `/v3/projects/7b649987d6af449288c15228a39aecd4` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:25.389337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b649987d6af449288c15228a39aecd4)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:25.391766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:25.436225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b649987d6af449288c15228a39aecd4', 'request_id': 'req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.443990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b649987d6af449288c15228a39aecd4', 'request_id': 'req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.450319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b649987d6af449288c15228a39aecd4', 'request_id': 'req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.461546 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] The token cache is being invalidate because project 7b649987d6af449288c15228a39aecd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:25.461838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.462482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.464005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1048/2077] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:25 2021] DELETE /identity/v3/projects/7b649987d6af449288c15228a39aecd4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:25.468053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:25.470154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:25.482889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0438-55b5-470c-87c9-fface5f49500 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:25.537702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:25.538567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:25.538845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:25.539120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] PATH_INFO: `/v3/users/ed96d56e95d84a0e88cf95fdc6f3439b` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:25.540300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed96d56e95d84a0e88cf95fdc6f3439b)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:25.542228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:25.584151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed96d56e95d84a0e88cf95fdc6f3439b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.596225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed96d56e95d84a0e88cf95fdc6f3439b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.602736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed96d56e95d84a0e88cf95fdc6f3439b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.603401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed96d56e95d84a0e88cf95fdc6f3439b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.603999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f32f4aea-20b0-48ba-9956-b70a9402d06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed96d56e95d84a0e88cf95fdc6f3439b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:25.616187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1030/2078] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:25 2021] DELETE /identity/v3/users/ed96d56e95d84a0e88cf95fdc6f3439b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:25.909301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:25.910818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:25.923873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6005-a5f4-4406-aa41-20e8fde6bb0f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:25.979471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:25.980325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:25.980605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:25.980880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] PATH_INFO: `/v3/projects/6f24a41a46f74a0887446762eae3171b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:25.982101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f24a41a46f74a0887446762eae3171b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:25.984050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.030038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f24a41a46f74a0887446762eae3171b', 'request_id': 'req-f3969593-d3f6-4c36-9919-16b58f56fdf1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:26.037346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f24a41a46f74a0887446762eae3171b', 'request_id': 'req-f3969593-d3f6-4c36-9919-16b58f56fdf1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:26.043222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f24a41a46f74a0887446762eae3171b', 'request_id': 'req-f3969593-d3f6-4c36-9919-16b58f56fdf1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:26.058481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] The token cache is being invalidate because project 6f24a41a46f74a0887446762eae3171b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:26.058937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:26.059709 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f3969593-d3f6-4c36-9919-16b58f56fdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:26.061470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1049/2079] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:25 2021] DELETE /identity/v3/projects/6f24a41a46f74a0887446762eae3171b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:26.068201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.068488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.068761 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.087950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:26.089190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:26.148126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1031/2080] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:26.157861 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.158166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.158464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.177201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:26.178463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:26.186797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1050/2081] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:26.191267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.201395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43556-7c66-47de-82a2-bf5f4a6439bb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.206750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.207430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.207755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.208044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.208916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:26.209273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.210959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.223129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1032/2082] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:26.227331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.237136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8679c-b90b-4598-8730-c82b2b5eca08 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.241987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.242660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.242963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.243294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.244036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.246115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.272718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1051/2083] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:26.277213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.288368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244888-b64a-48f3-bd35-16ba67752fff admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.347773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.348441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.348715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.349025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.349726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.351622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.371408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1033/2084] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:26.375667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.385995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92aa7b-471d-4744-8a71-fd28a040e3d5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.391097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.391994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.392286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.392572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.393363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.395031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.405385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1052/2085] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:26.409935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.420107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dccec7-6d86-4e0b-8352-38b10f0839f1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.424781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.425473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.425757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.426031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.426767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.428349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565c15b-663c-4748-9bf1-3f83692b70e5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.438459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1034/2086] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:26.442793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.452815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7234-7fe8-424f-ab54-8fa0dd941eec admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.457991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.458855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.459145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.459409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] PATH_INFO: `/v3/projects/a589fd2a46794487894b1be214fc7fa0/users/896eb85a4e4942ea9884aa50be0b4899/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.475270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a589fd2a46794487894b1be214fc7fa0, user_id=896eb85a4e4942ea9884aa50be0b4899, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.477958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.490760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1053/2087] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:26 2021] PUT /identity/v3/projects/a589fd2a46794487894b1be214fc7fa0/users/896eb85a4e4942ea9884aa50be0b4899/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:26.502591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.503082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.503185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.529969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] MFA Rules not processed for user `896eb85a4e4942ea9884aa50be0b4899`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:26.531219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:26.592048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1035/2088] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:26.596938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.655847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde67eb-0c6d-44b1-a756-16e21afda13c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.660818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.661568 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.661922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.662219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.662932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.665219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.689973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1054/2089] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:26.694590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.705858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226b72b-b5bf-4225-8726-80007e48beb1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.760198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.760857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.761170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.761471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.762163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.764066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.784227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1036/2090] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:26 2021] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:26.788631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.799594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b860e5-120d-443c-b5fe-cbb3b3a8ca75 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.804628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.805348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.805652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.805953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.806747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.808444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.819792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1055/2091] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:26.823859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.834861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dacbb7-792f-4bd5-8e09-49d7f3ea8226 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.839884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.840776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.841129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.841425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] PATH_INFO: `/v3/projects/0e07be1c6f884e9d93b301e5145fde5d/users/e66f18bd401e4f90b8c77011c4660545/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.856175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e07be1c6f884e9d93b301e5145fde5d, user_id=e66f18bd401e4f90b8c77011c4660545, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.859322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.873392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1037/2092] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:26 2021] PUT /identity/v3/projects/0e07be1c6f884e9d93b301e5145fde5d/users/e66f18bd401e4f90b8c77011c4660545/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:26.878805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.889350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c9b0e-d224-43e7-adf3-8054293fc2b0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.952173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.952853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.953189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:26.953469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:26.955033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:26.956968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3d3f2-06a0-44a1-b0b1-fa0e57b64f7a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:26.977168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1056/2093] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:26 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:26.978424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:26.990919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7b65-06a6-4062-8bd8-951dc69800e2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:26.998320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:26.999918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:26.999918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:27.000847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] PATH_INFO: `/v3/projects/0e07be1c6f884e9d93b301e5145fde5d/users/e66f18bd401e4f90b8c77011c4660545/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:27.004057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e07be1c6f884e9d93b301e5145fde5d, user_id=e66f18bd401e4f90b8c77011c4660545, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:27.008970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:27.023994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1038/2094] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:26 2021] PUT /identity/v3/projects/0e07be1c6f884e9d93b301e5145fde5d/users/e66f18bd401e4f90b8c77011c4660545/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:27.035590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:27.035590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:27.035934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:27.070900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] MFA Rules not processed for user `e66f18bd401e4f90b8c77011c4660545`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:27.072486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:27.178661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1057/2095] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:27 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:27.189147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:27.191262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:27.249054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514e958-4345-49a5-848f-c4c4ba4abd4b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:27.253685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:27.254374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:27.254601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:27.255011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:27.264301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:27.265784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e28c-ace1-4492-a3e3-e7e99e0ae4e5 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:27.276129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1039/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:27 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:27.327273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:27.328671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:27.342603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5f68-fb86-4b2a-ad43-a1c5744c2cf8 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:27.347639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:27.348341 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:27.348627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:27.348864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:27.419750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:27.421397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:27.433576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1058/2097] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:27 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:28.257739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:28.258217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:28.258294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:28.285977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] MFA Rules not processed for user `08df3859b35a488e90ce4ecf4d8f0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:28.294041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:28.378261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1040/2098] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:28 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:30.260289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:30.262316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:30.344155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dce29-fd54-4b4b-bdde-cba1c32e8a4b service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:30.348965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:30.349921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:30.350225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:30.350524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] PATH_INFO: `/v3/users/8f709fd4f3e946b1bbe761ae739bc7d9` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:30.351797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f709fd4f3e946b1bbe761ae739bc7d9)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:30.353933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:30.400840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f709fd4f3e946b1bbe761ae739bc7d9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.409032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f709fd4f3e946b1bbe761ae739bc7d9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.420530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f709fd4f3e946b1bbe761ae739bc7d9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.427731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f709fd4f3e946b1bbe761ae739bc7d9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.428448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1116d3f9-efd7-4a88-82f3-2fac9d94bac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f709fd4f3e946b1bbe761ae739bc7d9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.434329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1059/2099] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:30 2021] DELETE /identity/v3/users/8f709fd4f3e946b1bbe761ae739bc7d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:30.637857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:30.676428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b9cc4-1402-476c-9a81-8b321bdf3f8c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:30.769871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:30.771790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:30.772075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:30.772484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] PATH_INFO: `/v3/projects/7620025728b949fcbbcf988c3afc657d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:30.774396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7620025728b949fcbbcf988c3afc657d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:30.777305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:30.830835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7620025728b949fcbbcf988c3afc657d', 'request_id': 'req-da6d1573-9cd0-4207-826a-6f41f1a2e654'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.837819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7620025728b949fcbbcf988c3afc657d', 'request_id': 'req-da6d1573-9cd0-4207-826a-6f41f1a2e654'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.843770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7620025728b949fcbbcf988c3afc657d', 'request_id': 'req-da6d1573-9cd0-4207-826a-6f41f1a2e654'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.858133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] The token cache is being invalidate because project 7620025728b949fcbbcf988c3afc657d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:30.858472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.859705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:30.861468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1041/2100] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:30 2021] DELETE /identity/v3/projects/7620025728b949fcbbcf988c3afc657d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:30.867668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50fa8-7cb8-4c92-9450-5d7abc308469 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:30.867912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50fa8-7cb8-4c92-9450-5d7abc308469 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:30.868198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda50fa8-7cb8-4c92-9450-5d7abc308469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:30.887626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-dda50fa8-7cb8-4c92-9450-5d7abc308469 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:30.889197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-dda50fa8-7cb8-4c92-9450-5d7abc308469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:30.932028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:30.933673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:30.948627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1060/2101] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:30.957128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:30.957441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:30.957791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:30.976822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:30.978126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:30.987853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1061/2102] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:30.992089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:30.998611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1573-9cd0-4207-826a-6f41f1a2e654 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.003707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.004572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.004853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.005159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] PATH_INFO: `/v3/users/896eb85a4e4942ea9884aa50be0b4899` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.006386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=896eb85a4e4942ea9884aa50be0b4899)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.006578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87b29-a325-4ed8-b1cc-1cf291a4756c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.008304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.011588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.012212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.012514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.012812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.013638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:31.013980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.015703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.028008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1062/2103] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:54:31.033033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.043796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5c1d8-c811-4ee1-93f8-acdcc47f4878 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.048744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.049486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.049806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.050137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.050843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.052736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.054960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896eb85a4e4942ea9884aa50be0b4899'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.066872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896eb85a4e4942ea9884aa50be0b4899'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.074459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896eb85a4e4942ea9884aa50be0b4899'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.075268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896eb85a4e4942ea9884aa50be0b4899'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.075956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ffa276d-02d7-4198-b53b-56b56136d12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896eb85a4e4942ea9884aa50be0b4899'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.078752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1063/2104] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:31 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:31.083010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.084766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.089966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1042/2105] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:30 2021] DELETE /identity/v3/users/896eb85a4e4942ea9884aa50be0b4899 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:31.094331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.094669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.094940 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.111144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:31.112338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.150881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0349f5-1586-4782-9641-17ded03090b5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.173814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1043/2106] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:31.184176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.185571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.208184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.208658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.208954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.209245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.209947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.212000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.235311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1064/2107] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:31 2021] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:31.236891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.250711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9cd97-6037-4624-948b-0a0f0c240e70 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.250921 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a39e-31b4-40d4-a0e1-fb2f78d7d22c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.255210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.255766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.255897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.256132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.256408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.256523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.256683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.256969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.257708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.259271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.267861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.269588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.270588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1065/2108] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:31 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:31.275001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.281029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1044/2109] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:31.285736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc118be-ce2b-4fe8-8529-2c8fe4ba3cf4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.290570 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.291226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.291501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.291772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.292539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.294463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2655bf7-0b1a-457a-8842-58cbc794cafc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.317065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1066/2110] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:31 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:31.317887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.328607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9513432-9603-4ee0-a4df-5ad4d3526465 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.335316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.335983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.336265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.336769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] PATH_INFO: `/v3/projects/02517e51abb14a7d8fdd8b67319cef69/users/78312c1ca69c421db29f35cd27ca7521/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.356182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02517e51abb14a7d8fdd8b67319cef69, user_id=78312c1ca69c421db29f35cd27ca7521, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.361346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.379114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1045/2111] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:31 2021] PUT /identity/v3/projects/02517e51abb14a7d8fdd8b67319cef69/users/78312c1ca69c421db29f35cd27ca7521/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:31.383751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.384038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.384312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.408083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:31.410353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.475016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1067/2112] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:31.485728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.487494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.545135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9f95-1d0e-4a1b-8a49-eb4620b8ae22 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.550642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.551410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.551692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.551983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.562114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.564146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.569811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.571573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:31.574860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1046/2113] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:31.585521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2a024-14ca-4377-ba5c-f497e49c281a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.590781 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.591660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.591941 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.592213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] PATH_INFO: `/v3/projects/a589fd2a46794487894b1be214fc7fa0` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.593477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a589fd2a46794487894b1be214fc7fa0)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.595552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.642754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a589fd2a46794487894b1be214fc7fa0', 'request_id': 'req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.651311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a589fd2a46794487894b1be214fc7fa0', 'request_id': 'req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.658922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a589fd2a46794487894b1be214fc7fa0', 'request_id': 'req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.670955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] The token cache is being invalidate because project a589fd2a46794487894b1be214fc7fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:31.671267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.672019 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.673778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1068/2114] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:31 2021] DELETE /identity/v3/projects/a589fd2a46794487894b1be214fc7fa0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:31.677687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:31.688178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd04819-e550-41e9-b467-1078b29e7502 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:31.753504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:31.754810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:31.755230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:31.755455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] PATH_INFO: `/v3/users/e66f18bd401e4f90b8c77011c4660545` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:31.757139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66f18bd401e4f90b8c77011c4660545)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:31.759437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:31.807404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66f18bd401e4f90b8c77011c4660545'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.820120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66f18bd401e4f90b8c77011c4660545'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.827334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66f18bd401e4f90b8c77011c4660545'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.829151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66f18bd401e4f90b8c77011c4660545'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.829818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f45660d3-791f-43b7-a393-d9958b18452a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66f18bd401e4f90b8c77011c4660545'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:31.842965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1047/2115] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:31 2021] DELETE /identity/v3/users/e66f18bd401e4f90b8c77011c4660545 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:32.212899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.214376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:32.228100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242153a8-f0ab-4c79-ad4b-a8eb5e0540d7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.306784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.307662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.307947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.308224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] PATH_INFO: `/v3/projects/0e07be1c6f884e9d93b301e5145fde5d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.309497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e07be1c6f884e9d93b301e5145fde5d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.311557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.366673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e07be1c6f884e9d93b301e5145fde5d', 'request_id': 'req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:32.375617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e07be1c6f884e9d93b301e5145fde5d', 'request_id': 'req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:32.382654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e07be1c6f884e9d93b301e5145fde5d', 'request_id': 'req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:32.394550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] The token cache is being invalidate because project 0e07be1c6f884e9d93b301e5145fde5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:32.394841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:32.395544 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-4f07f6a4-2416-4ab6-ae8c-9a5cce7a42c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:32.397168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1069/2116] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:32 2021] DELETE /identity/v3/projects/0e07be1c6f884e9d93b301e5145fde5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:32.403331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.403331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.403752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.424369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:32.425632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:32.490537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1048/2117] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:32.498436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.498703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.498961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.519450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:32.520449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:32.530326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1070/2118] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:32.534622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.544391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752221-bb5b-4def-91d3-74ca67b2d04c None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.549280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.550007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.550359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.550684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.551545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:32.551910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.553608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.566842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1049/2119] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:32.575005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.585139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf70b-d272-496d-8676-3c924deea580 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.590140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.590796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.591075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.591359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.592124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.594052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.619714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1071/2120] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:32.623925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.634748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e19fc-c48b-4c63-afe7-e619d3a7c11c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.704699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.705411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.705676 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.705953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.706665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.708583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.731151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1050/2121] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:32.735538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.746491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b709194-5e1d-47ba-b586-7ee93523559b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.753747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.754828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.755422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.755701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.756479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.758115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.769799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1072/2122] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:32 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:32.773531 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.783513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28548c-c140-48dd-8e29-e7b1e51ef311 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.788080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.788737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.789034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.789471 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.790202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.791765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2e1a3-a919-4b79-8c27-e5cc18f483c2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.801786 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1051/2123] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:32.805792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:32.816366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c0-65dd-45a1-b52a-e43ed4a0fc07 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:32.821031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:32.821906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.822178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.822449 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] PATH_INFO: `/v3/projects/66c31ebcd7cf4fc380a4e64afd17f196/users/33e14f1df09144b982d0ef4033132a00/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.837294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c31ebcd7cf4fc380a4e64afd17f196, user_id=33e14f1df09144b982d0ef4033132a00, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:32.839920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:32.853134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1073/2124] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:32 2021] PUT /identity/v3/projects/66c31ebcd7cf4fc380a4e64afd17f196/users/33e14f1df09144b982d0ef4033132a00/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:32.863894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:32.864258 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:32.864603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:32.891180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] MFA Rules not processed for user `33e14f1df09144b982d0ef4033132a00`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:32.892391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:32.956136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1052/2125] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:32.961079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.024956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5678eb-3e0a-464b-ba1d-f4b03841fd6f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.029838 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.030497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.030782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.031059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.031776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.033711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.059672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1074/2126] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:32 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:33.064299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.075346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d458b-f2bd-4406-94b8-49a6d5a7cd36 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.132747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.133462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.133748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.134024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.134744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.136647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.158985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1053/2127] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:33 2021] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:33.162125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.173120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfd78f-2baf-4137-bf40-a2d94542655c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.177860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.178514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.178792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.179063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.179793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.181416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.192268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1075/2128] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:33.196285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.206008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c5fa-0277-496c-b193-d8357d403d23 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.210569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.211430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.211701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.211967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] PATH_INFO: `/v3/projects/422b7c0220384b8db8a823fd716cc165/users/02658e5ff2be4c6a88a49a249b570d67/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.226763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422b7c0220384b8db8a823fd716cc165, user_id=02658e5ff2be4c6a88a49a249b570d67, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.229430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.243318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1054/2129] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:33 2021] PUT /identity/v3/projects/422b7c0220384b8db8a823fd716cc165/users/02658e5ff2be4c6a88a49a249b570d67/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:33.247230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.257919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eff1b-4c3a-444b-be6b-3881135d80f3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.320670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.321403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.321802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.322149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.323038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.324888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f7d13-2299-49cd-8220-3ef9bec23fa9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.338588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1076/2130] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:33 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:33.340019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.352388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d863f-1713-4fea-8efe-444e05dd02c9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.357981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.358800 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.359082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.360010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] PATH_INFO: `/v3/projects/422b7c0220384b8db8a823fd716cc165/users/02658e5ff2be4c6a88a49a249b570d67/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.362362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] RBAC: Authorizing `identity:create_grant(project_id=422b7c0220384b8db8a823fd716cc165, user_id=02658e5ff2be4c6a88a49a249b570d67, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.365100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.375577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1055/2131] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:33 2021] PUT /identity/v3/projects/422b7c0220384b8db8a823fd716cc165/users/02658e5ff2be4c6a88a49a249b570d67/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:33.387404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7e7e-e279-4244-8361-83750851f735 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.387695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7e7e-e279-4244-8361-83750851f735 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.387994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7e7e-e279-4244-8361-83750851f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.414429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cfab7e7e-e279-4244-8361-83750851f735 None None] MFA Rules not processed for user `02658e5ff2be4c6a88a49a249b570d67`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:33.415676 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cfab7e7e-e279-4244-8361-83750851f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:33.489818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1077/2132] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:33 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:33.499807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:33.501939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:33.577078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5faa3-85cb-444b-85c2-08824f91241e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:33.595428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:33.596142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:33.596448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:33.596744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:33.680568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:33.682840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eee8f-d690-462a-b338-2f0603e36e1b service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:33.693656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1056/2133] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:33 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:35.842731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:35.844276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:35.844549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:35.874850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] MFA Rules not processed for user `78312c1ca69c421db29f35cd27ca7521`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:35.876395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:35.941904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1078/2134] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:35.951419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14d0a-0750-4503-8c6b-716dff604b65 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:35.951960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14d0a-0750-4503-8c6b-716dff604b65 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:35.952052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac14d0a-0750-4503-8c6b-716dff604b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:35.970552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2ac14d0a-0750-4503-8c6b-716dff604b65 None None] MFA Rules not processed for user `78312c1ca69c421db29f35cd27ca7521`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:35.971852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2ac14d0a-0750-4503-8c6b-716dff604b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:35.979000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1057/2135] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:37.067937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:37.069537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:37.170313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7cff-3bbb-49df-8c31-f5d03af47ec7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:37.181237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:37.182486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:37.183091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:37.183726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:37.200708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:37.202718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:37.232857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1079/2136] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:38.338556 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:38.339042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:38.339122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:38.370016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] MFA Rules not processed for user `78312c1ca69c421db29f35cd27ca7521`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:38.371519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:38.398303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1058/2137] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:40.561627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.563100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.590989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5747b-c96a-40de-a842-85a65ccd91f9 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.600358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.601429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.601921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.602385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.624242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.626571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70b63f-8acc-4330-8bb7-ea38575ece06 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.651033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1080/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:40 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:42.866265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:42.868775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:42.969659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7f43-dfbc-41b5-acb5-46659d43dfb6 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:42.978183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:42.982691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:42.984865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:42.985386 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] PATH_INFO: `/v3/users/917c7eddbb2b4078a110f7c91491f013` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:42.990617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917c7eddbb2b4078a110f7c91491f013)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:42.997743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:43.007485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:43.009399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:43.009881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:43.044782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:43.048130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:43.095332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917c7eddbb2b4078a110f7c91491f013'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:43.120822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917c7eddbb2b4078a110f7c91491f013'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:43.139143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917c7eddbb2b4078a110f7c91491f013'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:43.146923 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917c7eddbb2b4078a110f7c91491f013'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:43.151611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-4ecedb90-38d0-48a9-acdd-6e64aa1495d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917c7eddbb2b4078a110f7c91491f013'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:43.169024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1059/2139] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:42 2021] DELETE /identity/v3/users/917c7eddbb2b4078a110f7c91491f013 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:43.176457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:43.177149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:43.177590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:43.201014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1081/2140] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:54:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:43.201811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:43.203115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:43.259928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:43.261589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:43.325475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1060/2141] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:43.336739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:43.339470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:43.394119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19f0d-e9ad-4df4-8192-ccb89a171354 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:43.418657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028288c-f60f-48e3-98d2-1402e1aba27a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:43.427036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:43.428024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:43.428533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:43.429047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:43.441378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:43.443612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:43.455326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1061/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:43.481458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:43.482462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:43.482745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:43.483016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:43.550485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:43.552974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea5cd-80e6-4935-b374-7049fbb70b97 service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:43.563410 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1082/2143] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:54:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:54:44.241208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.242825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.282832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d9738-31e2-4525-9d16-a155f98cc6ff service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.295458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.296866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.297214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.297585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] PATH_INFO: `/v3/projects/ff725c599a374605a9ea87eef7228518` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.299367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff725c599a374605a9ea87eef7228518)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.301852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.376852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff725c599a374605a9ea87eef7228518', 'request_id': 'req-e175b08e-f252-4413-8acc-a70ed238bf3b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.386326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff725c599a374605a9ea87eef7228518', 'request_id': 'req-e175b08e-f252-4413-8acc-a70ed238bf3b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.399295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff725c599a374605a9ea87eef7228518', 'request_id': 'req-e175b08e-f252-4413-8acc-a70ed238bf3b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.423901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] The token cache is being invalidate because project ff725c599a374605a9ea87eef7228518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:44.424275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.425215 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e175b08e-f252-4413-8acc-a70ed238bf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.428031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1062/2144] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:44 2021] DELETE /identity/v3/projects/ff725c599a374605a9ea87eef7228518 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:44.433779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970ca7-e4ce-4556-937e-e4d84bef736f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.434773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970ca7-e4ce-4556-937e-e4d84bef736f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.435226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970ca7-e4ce-4556-937e-e4d84bef736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.462637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f9970ca7-e4ce-4556-937e-e4d84bef736f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:44.465234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f9970ca7-e4ce-4556-937e-e4d84bef736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.554747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1083/2145] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:44.562039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.562321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.562592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.586000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:44.587218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.600072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1063/2146] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:44.600277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.600277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.600277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.602165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.611899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b333a3b-e370-4349-80b8-630bd0991fe7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.617277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.617987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.618281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.618574 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.619371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:44.619714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.620461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:44.621479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.621935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.635636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1064/2147] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:44.639775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.650816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83659ab8-72e1-4260-8108-cf3bb5199b03 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.660510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.661480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.661950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.662227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.662941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.662941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.693121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1084/2148] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:44.701270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1065/2149] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:44.705898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.709784 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.712360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.717076 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4feb3c-c998-47e0-a1b6-2212b401c5d0 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.797513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.798694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.799150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.799284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03dd0-9401-4707-925e-f47abac3be57 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.799729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.801088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.804170 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.805244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397157-788b-428e-8873-0321cc9de152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.806013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397157-788b-428e-8873-0321cc9de152 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.806405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397157-788b-428e-8873-0321cc9de152 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.806775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397157-788b-428e-8873-0321cc9de152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.859701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1085/2150] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:44.861702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.877173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e498ed0-f6a4-45e9-b582-9eda6c39333f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.882787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.883453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.883821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.884123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.884863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.887031 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.898041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1086/2151] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:44.902351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.908501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25397157-788b-428e-8873-0321cc9de152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.910257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25397157-788b-428e-8873-0321cc9de152 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.912812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d98358-1f20-434b-986d-b8b96cb051e2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.918448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.919025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1066/2152] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:54:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:54:44.919294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.919647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.919988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.920827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.923744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57d738-a95f-4957-afe4-b0749b6e18e7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.937657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1087/2153] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:44.939491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397157-788b-428e-8873-0321cc9de152 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.954159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397157-788b-428e-8873-0321cc9de152 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.959127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.960096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.960268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.960541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] PATH_INFO: `/v3/projects/ac1e0fe7cd114218854dc7da8abf57fd/users/d6262a3a223f4dca9af257ca9c4297da/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.976790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1e0fe7cd114218854dc7da8abf57fd, user_id=d6262a3a223f4dca9af257ca9c4297da, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.980896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.997943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1067/2154] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:44 2021] PUT /identity/v3/projects/ac1e0fe7cd114218854dc7da8abf57fd/users/d6262a3a223f4dca9af257ca9c4297da/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:45.009556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.009883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.010330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.048069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] MFA Rules not processed for user `d6262a3a223f4dca9af257ca9c4297da`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:45.050639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.203327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1088/2155] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:45.220908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.223650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.293314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65c75-cfc8-40ed-adf8-888cdb8d963c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.298007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.299108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.299584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.300046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.313311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.315260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270a20a-fb75-4f61-80ce-bac78cf299d9 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.338244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1068/2156] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:45 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:45.356287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.387499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.387661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.387932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.412125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:45.414144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.468088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453ecf8-fbef-4ef7-a4a2-7bac5db3a164 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.475364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.476873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.477209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.477482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] PATH_INFO: `/v3/users/d6262a3a223f4dca9af257ca9c4297da` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.479304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6262a3a223f4dca9af257ca9c4297da)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.482698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.507823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1069/2157] 10.222.0.42 () {58 vars in 967 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:45.525587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.542665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6262a3a223f4dca9af257ca9c4297da'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.555672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6262a3a223f4dca9af257ca9c4297da'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.568331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6262a3a223f4dca9af257ca9c4297da'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.577803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6262a3a223f4dca9af257ca9c4297da'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.579560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4ac8fee-2dd6-40d3-bc38-3cd905e117ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6262a3a223f4dca9af257ca9c4297da'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.586213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1089/2158] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:45 2021] DELETE /identity/v3/users/d6262a3a223f4dca9af257ca9c4297da => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:45.590474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.590745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.591018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.604244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfd6ea-ffeb-41bd-a01f-d4addbfb827f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.608532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:45.609827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.668313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.669347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.669792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.670223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.672313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.684631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1090/2159] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:45.694915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.696335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.737478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.738983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.747562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1070/2160] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:54:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:54:45.768766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6607-7762-4ade-8d5a-03da767f2cc9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.780132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.780918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.781545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.782440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.796034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.798146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.808690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1091/2161] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:46.240179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.242183 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.267752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18857d-de38-46b8-b411-5415f2cd1b65 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.268673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.270145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.283008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.283914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.284193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.284464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] PATH_INFO: `/v3/users/33e14f1df09144b982d0ef4033132a00` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.285815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e14f1df09144b982d0ef4033132a00)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.286503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e714-de40-40da-86fc-7019dc513b7b service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.288585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.293048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.294225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.294681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.295450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] PATH_INFO: `/v3/projects/ac1e0fe7cd114218854dc7da8abf57fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.297694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1e0fe7cd114218854dc7da8abf57fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.299643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.354788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e14f1df09144b982d0ef4033132a00'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.361218 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1e0fe7cd114218854dc7da8abf57fd', 'request_id': 'req-ae53c128-16da-4539-afa1-ee9da38fcd8c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.370138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1e0fe7cd114218854dc7da8abf57fd', 'request_id': 'req-ae53c128-16da-4539-afa1-ee9da38fcd8c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.370629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e14f1df09144b982d0ef4033132a00'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.379369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1e0fe7cd114218854dc7da8abf57fd', 'request_id': 'req-ae53c128-16da-4539-afa1-ee9da38fcd8c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.379570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e14f1df09144b982d0ef4033132a00'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.379570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e14f1df09144b982d0ef4033132a00'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.380319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-cea61c63-35a5-4b69-b6ac-f5fdd6279963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e14f1df09144b982d0ef4033132a00'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.388730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] The token cache is being invalidate because project ac1e0fe7cd114218854dc7da8abf57fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:46.389164 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.390374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ae53c128-16da-4539-afa1-ee9da38fcd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:46.392923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1092/2162] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:46 2021] DELETE /identity/v3/projects/ac1e0fe7cd114218854dc7da8abf57fd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:46.395589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1071/2163] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:46 2021] DELETE /identity/v3/users/33e14f1df09144b982d0ef4033132a00 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:46.398698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39dbed-2203-4791-9540-7823ead442b7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.399017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39dbed-2203-4791-9540-7823ead442b7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.399395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39dbed-2203-4791-9540-7823ead442b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.417509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.417919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.418203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.420108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5e39dbed-2203-4791-9540-7823ead442b7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:46.421489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5e39dbed-2203-4791-9540-7823ead442b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.440927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:46.442435 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.509192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1093/2164] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:46.518500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.519046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.519517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.533114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1072/2165] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:46.542405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.548101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.562513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:46.563873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.581298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1094/2166] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:46.590139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.621401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2fb90-7323-4368-93e3-96a1dff6b726 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.638112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.638792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.639127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.639407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.640517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:46.640826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.643620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def29b6-7538-4315-bde1-1d403ed4c8db None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.647978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.648405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.649180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.649527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.649880 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.661914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.663745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.665706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1095/2167] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:46.673883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.684175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1073/2168] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:46.686754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8f81c-20fd-4515-b41d-aeb13b32cf71 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.694679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.696007 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.696444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.697195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.698024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.700252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.749314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1096/2169] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:46.749789 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.761956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c71-56d6-4539-8093-d43dddec3d0b service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.853065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.854058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.854516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.855180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.856515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.860203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.889929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1074/2170] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:46.894234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.907921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271921-e4f2-4701-becd-7a2b97e0983f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.916602 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.918286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.918609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.918949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.920270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.922056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.936289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1097/2171] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:46.940742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.955538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98b73-2a3f-4b85-8aaf-43f762124e84 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.966218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.967087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.967535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.968056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.969919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.971951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab953d0-cc78-4123-beef-a6f27000eae6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.995375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1075/2172] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:47.001704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:47.019493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42cd72-35d4-47b2-a246-07cbc8209f04 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:47.025321 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:47.026434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:47.026795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:47.027179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] PATH_INFO: `/v3/projects/f781f155903a4952b6c98187012839ef/users/87c340a8852940d998073b4e3a8e14f9/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:47.054881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f781f155903a4952b6c98187012839ef, user_id=87c340a8852940d998073b4e3a8e14f9, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:47.055086 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:47.082823 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1098/2173] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:47 2021] PUT /identity/v3/projects/f781f155903a4952b6c98187012839ef/users/87c340a8852940d998073b4e3a8e14f9/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:47.093255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:47.093693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:47.094138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:47.136890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] MFA Rules not processed for user `87c340a8852940d998073b4e3a8e14f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:47.141801 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:47.166955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:47.168860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:47.244742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862ea2-83ee-44db-8387-1a9d69a8ed97 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:47.249848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:47.250803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:47.251512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:47.251793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] PATH_INFO: `/v3/projects/66c31ebcd7cf4fc380a4e64afd17f196` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:47.253025 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c31ebcd7cf4fc380a4e64afd17f196)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:47.255061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:47.268702 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1076/2174] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:47 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:47.278955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:47.280420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:47.309323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c31ebcd7cf4fc380a4e64afd17f196', 'request_id': 'req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.320309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c31ebcd7cf4fc380a4e64afd17f196', 'request_id': 'req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.327674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c31ebcd7cf4fc380a4e64afd17f196', 'request_id': 'req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.338575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] The token cache is being invalidate because project 66c31ebcd7cf4fc380a4e64afd17f196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:47.338863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.339604 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.341301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1099/2175] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:47 2021] DELETE /identity/v3/projects/66c31ebcd7cf4fc380a4e64afd17f196 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:47.345705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:47.347034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:47.361171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ed1e-e11a-498c-a700-95d028f0126b None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:47.419621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:47.420698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:47.421117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:47.421493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:47.424249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:47.424571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e5cb2-ff44-4f81-a255-e40b42f93e6f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:47.430982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:47.432483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:47.432819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:47.433167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] PATH_INFO: `/v3/users/02658e5ff2be4c6a88a49a249b570d67` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:47.434693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02658e5ff2be4c6a88a49a249b570d67)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:47.437436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:47.499302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02658e5ff2be4c6a88a49a249b570d67'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.503872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:47.505648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:47.508550 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02658e5ff2be4c6a88a49a249b570d67'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.516904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1077/2176] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:47 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:47.523794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02658e5ff2be4c6a88a49a249b570d67'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.532211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02658e5ff2be4c6a88a49a249b570d67'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.533103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-231af2f8-31fd-4e42-8766-5cecd6eab540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02658e5ff2be4c6a88a49a249b570d67'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:47.539291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1100/2177] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:47 2021] DELETE /identity/v3/users/02658e5ff2be4c6a88a49a249b570d67 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:48.046489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.058961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da5119-9b92-45f9-9473-712601067bbf service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.130506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.131364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.131641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.131909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] PATH_INFO: `/v3/projects/422b7c0220384b8db8a823fd716cc165` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.133134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422b7c0220384b8db8a823fd716cc165)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.135013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.192595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422b7c0220384b8db8a823fd716cc165', 'request_id': 'req-ab38bbe7-6fac-46e4-842c-c9810c99a038'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.201960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422b7c0220384b8db8a823fd716cc165', 'request_id': 'req-ab38bbe7-6fac-46e4-842c-c9810c99a038'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.214721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422b7c0220384b8db8a823fd716cc165', 'request_id': 'req-ab38bbe7-6fac-46e4-842c-c9810c99a038'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.229196 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] The token cache is being invalidate because project 422b7c0220384b8db8a823fd716cc165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:48.229592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.230346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.231920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1078/2178] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:48 2021] DELETE /identity/v3/projects/422b7c0220384b8db8a823fd716cc165 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:48.241805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192e03-fb91-495b-99de-a30286c50738 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.242097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192e03-fb91-495b-99de-a30286c50738 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.242375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192e03-fb91-495b-99de-a30286c50738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.264454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5d192e03-fb91-495b-99de-a30286c50738 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:48.266211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5d192e03-fb91-495b-99de-a30286c50738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.273895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.275374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.356332 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1101/2179] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:48.356571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38bbe7-6fac-46e4-842c-c9810c99a038 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.362070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.363092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.363453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.363661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] PATH_INFO: `/v3/users/9fd9d69a9cc1454facb22e3b7032ff54` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.364914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd9d69a9cc1454facb22e3b7032ff54)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.365036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.365316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.365593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.366886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.388651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:48.390135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.400219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1102/2180] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:48.411210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.426376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b7e5-0326-4e25-a345-3df5d459a26b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.430195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd9d69a9cc1454facb22e3b7032ff54'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.432226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.433160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.433586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.434046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.434928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:48.435227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.436913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.447274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd9d69a9cc1454facb22e3b7032ff54'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.451825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1103/2181] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:48.456987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.461149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd9d69a9cc1454facb22e3b7032ff54'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.461979 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd9d69a9cc1454facb22e3b7032ff54'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.463210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e385aff4-4e4e-42de-8374-81a0d6a76b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd9d69a9cc1454facb22e3b7032ff54'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:48.469627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caec15-225b-4a7e-a252-a31194b3e6d7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.476608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.477912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.478369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.478487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1079/2182] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:48 2021] DELETE /identity/v3/users/9fd9d69a9cc1454facb22e3b7032ff54 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:48.478989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.479773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.481817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.483094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.483378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.483648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.503461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:48.504866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.515082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1104/2183] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:48.519231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.520937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.570771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1080/2184] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:48.583128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.584737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.589626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b492-e221-46d7-a8b8-71f8a30d307b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.597471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.598148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.598597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.599030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.599896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.602165 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.623118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1105/2185] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:48.628012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.642168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a83376-bf34-4481-864b-bf4e8ba4e2bf admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.647309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.648389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.648669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.648938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.649704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.651297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.658212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913022-d25d-440a-8f48-62eaaa69a729 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.665946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1106/2186] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:48.668384 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.682617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995c18c-685c-4b2a-abaf-da33049dcab1 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.688275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.688935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.689618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.689898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.690807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.692418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.705403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1107/2187] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:48.709601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.720700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b6a2d-8a74-4894-9006-5f525fd3ed39 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.726644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.727664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.728135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.728581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.728826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.733286 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.733685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.734069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] PATH_INFO: `/v3/projects/c1d044dc68584dea8d9fffd7ebe10826/users/9cbdead697984cceaee20a14b5138e2f/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.743832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.746455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a736438-c99d-4935-a817-9d81ea86c542 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.754997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d044dc68584dea8d9fffd7ebe10826, user_id=9cbdead697984cceaee20a14b5138e2f, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.758102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.763795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1081/2188] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:54:48.774335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1108/2189] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:48 2021] PUT /identity/v3/projects/c1d044dc68584dea8d9fffd7ebe10826/users/9cbdead697984cceaee20a14b5138e2f/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:48.779607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.780184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.780529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.799354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:48.800513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.868439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1082/2190] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:48.878531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:48.880717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:48.946933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928047b-df54-46a5-9f2b-7d8e162bac1f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:48.952457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:48.953155 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:48.954057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:48.954343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:48.964167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:48.965671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0926-913e-4981-95ce-8575e2d1a4cf service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:48.976528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1109/2191] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:49.023994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.026059 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.050543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c22b50-be3b-48e9-ae88-cf11f662fb73 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.058025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.059185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.063512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.063805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] PATH_INFO: `/v3/projects/0cfd34669b024b05945786f9b331d29d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.067530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfd34669b024b05945786f9b331d29d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.069922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.155985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfd34669b024b05945786f9b331d29d', 'request_id': 'req-84920944-59b3-4815-9b24-6cce5374442d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:49.168307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfd34669b024b05945786f9b331d29d', 'request_id': 'req-84920944-59b3-4815-9b24-6cce5374442d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:49.178611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfd34669b024b05945786f9b331d29d', 'request_id': 'req-84920944-59b3-4815-9b24-6cce5374442d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:49.201085 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] The token cache is being invalidate because project 0cfd34669b024b05945786f9b331d29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:49.201552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:49.202494 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-84920944-59b3-4815-9b24-6cce5374442d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:49.205265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1083/2192] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:49 2021] DELETE /identity/v3/projects/0cfd34669b024b05945786f9b331d29d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:49.213083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.213497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.213877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.235326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:49.236841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.300284 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1110/2193] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:49.310010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.310530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.310926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.337326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:49.338672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.347119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1084/2194] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:49.351621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.363261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4dbe3-e056-4004-aa1e-261e1cff66bc None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.368827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.369045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.369196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.369722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.370478 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:49.370788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.372435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.388996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1111/2195] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:49.392297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.402028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f72b0-3f4f-4784-b24d-27f0b8934798 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.407274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.407935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.408217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.408489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.409252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.411319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.442950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1085/2196] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:49 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:49.444182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.455222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0a1a-8671-4b9d-a7a7-308a78af6bf4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.535087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.535776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.536036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.536436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.537172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.539090 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.560895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1112/2197] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:49 2021] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:49.565893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.577415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9ae67-4683-4f3b-a339-7b22b818e69a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.582177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.582838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.583115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.583389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.584126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.585756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.600776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1086/2198] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:49.602292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.613549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1341-0b51-4c58-97b3-1925aa31b4b5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.618309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.618968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.619247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.619521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.620260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.621887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d45c-d54a-4af9-a68f-731350a8bb87 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.636032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1113/2199] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:49.637302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.647829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23237f2-5feb-4236-a33f-ffeb328b06f4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.652670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.653632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.653912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.654179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] PATH_INFO: `/v3/projects/32befda3e401478ca1c53c59a412e4b0/users/7d938e347ce54365be2b15647111246c/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.669066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=32befda3e401478ca1c53c59a412e4b0, user_id=7d938e347ce54365be2b15647111246c, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.671678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.686584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1087/2200] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:49 2021] PUT /identity/v3/projects/32befda3e401478ca1c53c59a412e4b0/users/7d938e347ce54365be2b15647111246c/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:49.692150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa60ed-30d3-4c73-b46a-11312cd36f2c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.692473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa60ed-30d3-4c73-b46a-11312cd36f2c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.692753 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa60ed-30d3-4c73-b46a-11312cd36f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.711140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-44aa60ed-30d3-4c73-b46a-11312cd36f2c None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:49.712346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-44aa60ed-30d3-4c73-b46a-11312cd36f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.775382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1114/2201] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:49.787037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:49.788913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:49.865640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601dde7-b5ec-40fa-ad6b-ce01718fe4fa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:49.869883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:49.870659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:49.871018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:49.871378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:49.881904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:49.883590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:49.899672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1088/2202] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:55.857775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:55.858331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:55.858331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:55.885569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] MFA Rules not processed for user `9cbdead697984cceaee20a14b5138e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:55.886769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:55.964595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1115/2203] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:55 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:55.967701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:55.969745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:55.986484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2317-b5f6-4068-b8e3-1f0c0d6f4a31 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.001580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.002582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.003041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.003538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.005793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.008206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4cb7f-d399-4ed8-9505-7244f4740fa5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.072807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1089/2204] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:55 2021] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:56.076138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.094222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d5a0-1d19-458d-82d0-7bf208f7a046 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.173884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.174661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.175008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.175350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.176606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.186461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.214002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.214280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.214555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.219616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1116/2205] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:56 2021] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:56.220986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.237123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee6e7-9d29-412f-bcc3-eea044e382b6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.245015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.245950 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.246231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.246505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.247380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.249032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.257006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] MFA Rules not processed for user `7d938e347ce54365be2b15647111246c`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:56.258845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:56.267220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1117/2206] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:56 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:56.272221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.286725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6fa36-74ea-4417-b0c0-53a251b504ed admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.293657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.294796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.295091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.295339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] PATH_INFO: `/v3/projects/7b12a249e4c544a693ff1a51a902e0cd/users/b9e680312b7642fb813c1e32d54022c1/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.323312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b12a249e4c544a693ff1a51a902e0cd, user_id=b9e680312b7642fb813c1e32d54022c1, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.329726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.348400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1118/2207] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:56 2021] PUT /identity/v3/projects/7b12a249e4c544a693ff1a51a902e0cd/users/b9e680312b7642fb813c1e32d54022c1/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:56.351020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.365077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1090/2208] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:54:56 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:56.369815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.385563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd4d32-a4a1-4fb6-a000-2019a54cce59 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.432935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956afb11-3f18-49f9-900e-bd56c12fb540 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.440830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.441762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.442152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.442555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.443439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.445168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.457040 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1119/2209] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:56 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:56.461020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.464690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.465576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.466114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.466306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.467071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.469529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.480586 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84ff2d-445a-4927-93f6-af037afd9fd7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.486695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.489872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.491190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.491685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] PATH_INFO: `/v3/projects/7b12a249e4c544a693ff1a51a902e0cd/users/b9e680312b7642fb813c1e32d54022c1/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.496405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b12a249e4c544a693ff1a51a902e0cd, user_id=b9e680312b7642fb813c1e32d54022c1, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.500702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.518798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1091/2210] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:56 2021] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:56.519054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1120/2211] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:56 2021] PUT /identity/v3/projects/7b12a249e4c544a693ff1a51a902e0cd/users/b9e680312b7642fb813c1e32d54022c1/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:56.522427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.613354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76ea7-aa60-427b-984d-d5a5e95c9953 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.622757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.629095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.629507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.630174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.632280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.634306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.670392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.676694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1092/2212] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:56 2021] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:56.782066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955aae8-1d5e-40ff-b664-4f1e5c295c87 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.791879 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.792854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.793306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.793741 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.794950 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.796755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.810250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1121/2213] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:56 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:56.814330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.825840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084055c-5973-44f2-9cc8-fd0dca1034a5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:56.831810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:56.832799 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:56.833122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:56.833402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] PATH_INFO: `/v3/projects/02f35ba4353d428da4b41e64d973aa89/users/1ae55e2e6d784a738faebb4f10aa9c76/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:56.856322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f35ba4353d428da4b41e64d973aa89, user_id=1ae55e2e6d784a738faebb4f10aa9c76, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:56.858981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:56.880050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1093/2214] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:56 2021] PUT /identity/v3/projects/02f35ba4353d428da4b41e64d973aa89/users/1ae55e2e6d784a738faebb4f10aa9c76/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:56.884275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:56.897735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a6b6-3903-4496-80d9-b70ae8ef80be admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:57.017519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:57.018696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:57.019275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:57.019727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:57.020742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:57.023301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50bf41-d085-4b53-94b2-fe14abda8e37 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:57.045268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1122/2215] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:56 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:57.050043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:57.068632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b05eaf-79d0-4a69-9060-2a76882f0f06 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:57.090230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:57.091232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:57.091569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:57.092001 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] PATH_INFO: `/v3/projects/02f35ba4353d428da4b41e64d973aa89/users/1ae55e2e6d784a738faebb4f10aa9c76/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:57.097919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f35ba4353d428da4b41e64d973aa89, user_id=1ae55e2e6d784a738faebb4f10aa9c76, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:57.103036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:57.164461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1094/2216] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:57 2021] PUT /identity/v3/projects/02f35ba4353d428da4b41e64d973aa89/users/1ae55e2e6d784a738faebb4f10aa9c76/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:04.781690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b526-d7c6-469b-a548-bfc6745cbc68 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:04.782608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b526-d7c6-469b-a548-bfc6745cbc68 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:04.783098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2b526-d7c6-469b-a548-bfc6745cbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:04.854312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-45f2b526-d7c6-469b-a548-bfc6745cbc68 None None] MFA Rules not processed for user `b9e680312b7642fb813c1e32d54022c1`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:04.855698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-45f2b526-d7c6-469b-a548-bfc6745cbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:04.970886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1123/2217] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:04 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:04.980982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:04.982943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:05.063771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737923-5009-427c-9936-aedd7505e96d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:05.069151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:05.070904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:05.071455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:05.072063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:05.108122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117797-ad24-4731-8b93-41ae8528077b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:05.108797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117797-ad24-4731-8b93-41ae8528077b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:05.109815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64117797-ad24-4731-8b93-41ae8528077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:05.157551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-64117797-ad24-4731-8b93-41ae8528077b None None] MFA Rules not processed for user `1ae55e2e6d784a738faebb4f10aa9c76`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:05.165902 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-64117797-ad24-4731-8b93-41ae8528077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:05.186675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:05.189169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3068b-836c-47db-a3c4-07c823fa7b39 service glance] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:05.213422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1095/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:04 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:05.264732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1124/2219] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:05 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:05.361151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:05.361463 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:05.361763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:05.381317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:05.382692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:05.460149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1096/2220] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:55:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:05.475625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117797-ad24-4731-8b93-41ae8528077b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:05.477468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-64117797-ad24-4731-8b93-41ae8528077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:05.617404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:05.618796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:05.644173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64117797-ad24-4731-8b93-41ae8528077b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:05.654134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:05.654802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:05.655089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:05.655368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:05.672853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:05.674772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfc1d3-bceb-4940-8485-1ef62ccc42df service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:05.683899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1125/2221] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:55:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:55:05.774803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a9e8d-926b-4e66-9333-5a6fb128b8cd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:05.785915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:05.786634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:05.787461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:05.787760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:05.895796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:05.898106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:05.927798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1097/2222] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:05 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:07.376628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e097a-1119-4ed7-b75b-087a877c83ad None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:07.377987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e097a-1119-4ed7-b75b-087a877c83ad None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:07.378474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e097a-1119-4ed7-b75b-087a877c83ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:07.410679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-055e097a-1119-4ed7-b75b-087a877c83ad None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:07.460034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-055e097a-1119-4ed7-b75b-087a877c83ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:07.494065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1126/2223] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:55:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:07.509736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:07.556220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138433-3d17-47b4-8977-fd28a648a38b service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:07.587402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:07.588371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:07.588873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:07.593716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:07.607635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:07.616582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:07.637528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1098/2224] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:55:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:55:09.007418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde575-f2c1-442e-9d17-802d63763cb3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:09.007980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde575-f2c1-442e-9d17-802d63763cb3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:09.007980 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde575-f2c1-442e-9d17-802d63763cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:09.114068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f4cde575-f2c1-442e-9d17-802d63763cb3 None None] MFA Rules not processed for user `7d938e347ce54365be2b15647111246c`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:09.127084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f4cde575-f2c1-442e-9d17-802d63763cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:09.183272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1127/2225] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:10.457440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:10.459846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:10.692454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312ba5d-efef-4039-8eef-ca2cdb69e48c service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:10.709928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:10.712374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:10.729909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:10.732527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] PATH_INFO: `/v3/users/87c340a8852940d998073b4e3a8e14f9` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:10.749063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c340a8852940d998073b4e3a8e14f9)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:10.752132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:10.911534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c340a8852940d998073b4e3a8e14f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:10.950032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c340a8852940d998073b4e3a8e14f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:10.969691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c340a8852940d998073b4e3a8e14f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:10.970533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c340a8852940d998073b4e3a8e14f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:10.973641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c340a8852940d998073b4e3a8e14f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:11.039094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1099/2226] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:10 2021] DELETE /identity/v3/users/87c340a8852940d998073b4e3a8e14f9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:11.040617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:11.041129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:11.041382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:11.143652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:11.155005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:11.427353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1128/2227] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:11.440177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:11.441375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:11.569502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d546c-be62-4d9b-bc33-ea1eb5b7eb47 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:11.574173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:11.575166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:11.575855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:11.576499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:11.597743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:11.599374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:11.612649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1100/2228] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:12.334448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:12.336128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:12.365097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa45b68-ec30-42af-af4e-adcd9d967bcd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:12.385782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:12.386654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:12.386940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:12.387211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] PATH_INFO: `/v3/projects/f781f155903a4952b6c98187012839ef` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:12.398863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f781f155903a4952b6c98187012839ef)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:12.413630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:12.532426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f781f155903a4952b6c98187012839ef', 'request_id': 'req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:12.550666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f781f155903a4952b6c98187012839ef', 'request_id': 'req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:12.568852 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f781f155903a4952b6c98187012839ef', 'request_id': 'req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:12.605446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] The token cache is being invalidate because project f781f155903a4952b6c98187012839ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:12.605945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:12.614471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9c0dd6d2-ca79-495f-bad6-8285dabfb0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:12.629890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1129/2229] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:12 2021] DELETE /identity/v3/projects/f781f155903a4952b6c98187012839ef => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:18.380035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.382570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.408481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e5d9-95ee-4993-9c94-0d20fe14fae0 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.567259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26486-857f-4187-9678-872810d98334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.572586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26486-857f-4187-9678-872810d98334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.573145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26486-857f-4187-9678-872810d98334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.573628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e26486-857f-4187-9678-872810d98334 admin admin] PATH_INFO: `/v3/users/51328fc8d387442e99171c0299fdc41e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.577304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26486-857f-4187-9678-872810d98334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51328fc8d387442e99171c0299fdc41e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.579997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e26486-857f-4187-9678-872810d98334 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.667437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51328fc8d387442e99171c0299fdc41e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.700017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51328fc8d387442e99171c0299fdc41e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.713483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51328fc8d387442e99171c0299fdc41e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.715328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51328fc8d387442e99171c0299fdc41e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.715949 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51328fc8d387442e99171c0299fdc41e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.752344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1101/2230] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:18 2021] DELETE /identity/v3/users/51328fc8d387442e99171c0299fdc41e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:18.757240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.758189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.758701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.801917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:18.805929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.980573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1130/2231] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:18.994723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.996247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:19.083993 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e26486-857f-4187-9678-872810d98334 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.087975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.088639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.088915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.089238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.100290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.101747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cac9ad-a8c4-4a18-a025-e7308dd54117 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.113172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1102/2232] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:19.696675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.698315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:19.754768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479c73-3bd6-47ae-95ed-b48b804d09d6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.769950 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.771733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.772174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.772635 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] PATH_INFO: `/v3/projects/faae26ffde604c639f773be505ece9a4` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.777808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=faae26ffde604c639f773be505ece9a4)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.780269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.917226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faae26ffde604c639f773be505ece9a4', 'request_id': 'req-f0345a8e-ac96-4350-b736-01e7249bfdcd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.930794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faae26ffde604c639f773be505ece9a4', 'request_id': 'req-f0345a8e-ac96-4350-b736-01e7249bfdcd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.940899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faae26ffde604c639f773be505ece9a4', 'request_id': 'req-f0345a8e-ac96-4350-b736-01e7249bfdcd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.962925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] The token cache is being invalidate because project faae26ffde604c639f773be505ece9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:19.963237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.965351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-f0345a8e-ac96-4350-b736-01e7249bfdcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.967248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1131/2233] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:19 2021] DELETE /identity/v3/projects/faae26ffde604c639f773be505ece9a4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:22.918294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.918808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.918899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.940793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] MFA Rules not processed for user `9cbdead697984cceaee20a14b5138e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:22.942193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:23.076149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1103/2234] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:22 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:35.360702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795852f-2cc4-454b-b65a-f96f8c80ae12 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:35.361240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795852f-2cc4-454b-b65a-f96f8c80ae12 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:35.361334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795852f-2cc4-454b-b65a-f96f8c80ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:35.380929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8795852f-2cc4-454b-b65a-f96f8c80ae12 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:35.382193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8795852f-2cc4-454b-b65a-f96f8c80ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:35.456957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1132/2235] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:55:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:35.471194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:35.473678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:35.590980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc21b-274a-4d07-884b-4a95f1d98b0f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:35.597410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:35.598079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:35.598413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:35.598725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:35.614547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:35.622568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:35.645935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1104/2236] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:55:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:55:39.871113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:39.871719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:39.872000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:39.892899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:39.894142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:39.901818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1133/2237] 10.222.0.42 () {58 vars in 967 bytes} [Tue Oct 12 16:55:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:39.916166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:39.926986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8116-c1de-4542-9168-ce3236de3fa8 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:39.932736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:39.933523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:39.933884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:39.934232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:39.944741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:39.946561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:39.956210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1105/2238] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:55:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:55:42.182966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:42.184447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:42.294711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c82a2-97b6-4d62-bfa3-0b5653fe5dfd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:42.300202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:42.301385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:42.301664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:42.302192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] PATH_INFO: `/v3/users/08df3859b35a488e90ce4ecf4d8f0df1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:42.303497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df3859b35a488e90ce4ecf4d8f0df1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:42.306023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:42.351133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df3859b35a488e90ce4ecf4d8f0df1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.359388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df3859b35a488e90ce4ecf4d8f0df1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.370579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df3859b35a488e90ce4ecf4d8f0df1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.378202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df3859b35a488e90ce4ecf4d8f0df1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.379000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b271567-0fd0-45a8-b593-5d41e8df8181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df3859b35a488e90ce4ecf4d8f0df1'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.385393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1134/2239] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:42 2021] DELETE /identity/v3/users/08df3859b35a488e90ce4ecf4d8f0df1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:42.595977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:42.621104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2beed4-1bf2-4db4-8273-785d2884a7f8 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:42.707154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:42.708014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:42.708294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:42.708570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] PATH_INFO: `/v3/projects/6d8c136dd5664774bdce2f594a9fe8d3` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:42.709807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8c136dd5664774bdce2f594a9fe8d3)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:42.711743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:42.756772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8c136dd5664774bdce2f594a9fe8d3', 'request_id': 'req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.762842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8c136dd5664774bdce2f594a9fe8d3', 'request_id': 'req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.770426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8c136dd5664774bdce2f594a9fe8d3', 'request_id': 'req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.785295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] The token cache is being invalidate because project 6d8c136dd5664774bdce2f594a9fe8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:42.785775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.786772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3c5ad3a8-0a7e-449e-b548-5e190faa4f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:42.788749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1106/2240] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:42 2021] DELETE /identity/v3/projects/6d8c136dd5664774bdce2f594a9fe8d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:42.794777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:42.795103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:42.795412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:42.818234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:42.819464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:42.888256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1135/2241] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:42.903125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:42.903496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:42.903925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:42.987770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:42.989088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:43.055958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1107/2242] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:43.061856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.130321 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6cd47-c8db-4d6c-ba8c-4d5d45f740bc None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.135123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.135777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.136049 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.136315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.137395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:43.137697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.139938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.151370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1136/2243] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:43.156115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.165228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0959c4b-89b4-4cd2-ac7e-1944262e0e99 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.170044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.170715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.170997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.171269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.171964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.173922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.210068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1108/2244] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:43 2021] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:55:43.214236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.224566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e0c9-2d87-4145-b17f-cea8331fe267 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.278959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.279547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.279858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.280138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.280855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.282808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.310447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1137/2245] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:43 2021] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:43.314798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.325551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ae89-e4e8-4b34-93f2-1f0ed95ae785 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.332822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.333682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.334003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.334393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.335277 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.337392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.349096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1109/2246] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:43.353336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.364810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d768e3-e647-4392-9bd8-040b1a8c5f00 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.379537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.380510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.380993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.381474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.382393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.387075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6fc33-bdbc-45f1-8071-81d1cd7efcf7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.402210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1138/2247] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:43.403540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.414643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c2d5-7f2f-4c2d-ac7b-f5461218efde admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.424133 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.425108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.425394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.425670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] PATH_INFO: `/v3/projects/7c6f85a88c414fb89d201de553183975/users/5afbc6b3cda5451a94e1a46081776b85/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.442444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6f85a88c414fb89d201de553183975, user_id=5afbc6b3cda5451a94e1a46081776b85, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.445152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.459943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1110/2248] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:43 2021] PUT /identity/v3/projects/7c6f85a88c414fb89d201de553183975/users/5afbc6b3cda5451a94e1a46081776b85/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:43.469963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178d3c-e728-471b-bfcf-5dc3f50ed2c0 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.470281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178d3c-e728-471b-bfcf-5dc3f50ed2c0 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.470517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178d3c-e728-471b-bfcf-5dc3f50ed2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.504180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c1178d3c-e728-471b-bfcf-5dc3f50ed2c0 None None] MFA Rules not processed for user `5afbc6b3cda5451a94e1a46081776b85`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:43.505516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c1178d3c-e728-471b-bfcf-5dc3f50ed2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:43.569652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1139/2249] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:55:43 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:43.581715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:43.583735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:43.655577 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188c25-cc9c-4724-8d6d-194038d7eb54 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:43.659750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:43.660421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:43.660700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:43.660995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:43.671288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:43.672855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:43.692711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1111/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:43 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:51.711927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:51.712475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:51.712475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:51.730860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:51.732063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:51.789757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1140/2251] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:55:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:51.814841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:51.816740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:51.930855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193277-ff03-4a0b-9abe-6d9f5e601257 service glance] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:51.937040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:51.937715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:51.938095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:51.938372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:51.951837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:51.953545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0de94f-b21d-40e3-b17c-f223f6472b1c service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:51.966252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1112/2252] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:55:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:56:05.482594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:05.484675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:05.566273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857934-aeea-48fa-b9d2-e45a9e5b924d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:05.575106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:05.575868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:05.576228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:05.576503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:05.578389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:05.638493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:05.639916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbaed8-3f08-4bef-ad06-4f1dde1b13c2 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:05.649466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1141/2253] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:05 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:07.382229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0c69-14fe-4e7a-8f22-577cfdb8dc36 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.383255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0c69-14fe-4e7a-8f22-577cfdb8dc36 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.383559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0c69-14fe-4e7a-8f22-577cfdb8dc36 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.386132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1113/2254] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:56:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:56:07.394188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea96f2-1fc0-4d02-9870-6368a4deb07a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.394691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea96f2-1fc0-4d02-9870-6368a4deb07a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.395387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea96f2-1fc0-4d02-9870-6368a4deb07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.434549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-0fea96f2-1fc0-4d02-9870-6368a4deb07a None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:07.435738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0fea96f2-1fc0-4d02-9870-6368a4deb07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:07.511800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1142/2255] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:56:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:07.525226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0c69-14fe-4e7a-8f22-577cfdb8dc36 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.535983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0c69-14fe-4e7a-8f22-577cfdb8dc36 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.539632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.540365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.540717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.541104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.551774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.553324 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0598ff-7bba-4a61-ba4b-8e3ef19b6766 service glance] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.565459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1114/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:07.664338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6e656-30d7-44b4-a899-d944aa5eabb7 None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.665159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6e656-30d7-44b4-a899-d944aa5eabb7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.665643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6e656-30d7-44b4-a899-d944aa5eabb7 None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.670949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1143/2257] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:56:07 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:56:07.677548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.678174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.678452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.702871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:07.704285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:07.713236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1115/2258] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:56:07 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:07.726786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6e656-30d7-44b4-a899-d944aa5eabb7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.742281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6e656-30d7-44b4-a899-d944aa5eabb7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.747416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.748388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.748913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.749700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.758761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.760259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.768228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1144/2259] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:16.953911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:16.955684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:17.045928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fe54-2e80-48e6-8fba-58cc1e325077 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:17.050939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:17.051592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:17.051868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:17.052172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:17.053977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:17.066375 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:17.068527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502bfa7-5b50-4442-864c-ca2b57248711 service placement] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:17.079738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1116/2260] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:16 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:18.977545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.037940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c984-005d-4e62-9d2b-0f13929c2890 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.042588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.043337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.043614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.043883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] PATH_INFO: `/v3/users/5afbc6b3cda5451a94e1a46081776b85` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.045126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afbc6b3cda5451a94e1a46081776b85)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.047033 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:19.093589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afbc6b3cda5451a94e1a46081776b85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.101267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afbc6b3cda5451a94e1a46081776b85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.112559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afbc6b3cda5451a94e1a46081776b85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.119993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afbc6b3cda5451a94e1a46081776b85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.120668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afbc6b3cda5451a94e1a46081776b85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.127193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1145/2261] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:18 2021] DELETE /identity/v3/users/5afbc6b3cda5451a94e1a46081776b85 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:19.132180 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.132652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.132750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.151120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:19.152306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:19.216813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1117/2262] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:56:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:19.226946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.228397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:19.285091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9abe27-6e40-4826-8255-77723693ffe2 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.289064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.289696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.290125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.290232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.299452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.300886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c637958-fa07-4132-82de-79775bfc4490 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:19.310993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1146/2263] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:19.594763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.596330 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:19.608648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7abf6-8170-442a-84ba-d3057c6a1475 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.613315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.614166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.614443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.615423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] PATH_INFO: `/v3/projects/7c6f85a88c414fb89d201de553183975` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.616758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6f85a88c414fb89d201de553183975)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.618741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:19.665034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6f85a88c414fb89d201de553183975', 'request_id': 'req-9cdadb15-928a-41fc-a2d7-d30e11a0d183'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.671147 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6f85a88c414fb89d201de553183975', 'request_id': 'req-9cdadb15-928a-41fc-a2d7-d30e11a0d183'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.676466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6f85a88c414fb89d201de553183975', 'request_id': 'req-9cdadb15-928a-41fc-a2d7-d30e11a0d183'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.688707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] The token cache is being invalidate because project 7c6f85a88c414fb89d201de553183975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:19.689025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.689657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9cdadb15-928a-41fc-a2d7-d30e11a0d183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:19.691165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1118/2264] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:19 2021] DELETE /identity/v3/projects/7c6f85a88c414fb89d201de553183975 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:19.697729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.698020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.698296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.715573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:19.716756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:19.773486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1147/2265] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:56:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:19.781515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.781805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.782086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.802928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:19.804479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:19.814104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1119/2266] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:56:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:19.818095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.828074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d468f8-e4c2-4862-b72d-8bae1f0fa11d None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.832760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.833481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.833762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.834054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.834794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:56:19.835097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.836730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:19.851747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1148/2267] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:56:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:56:19.852988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.863557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb57d3-c339-4c8f-855b-11bd9887d7a3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.869962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.871084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.871568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.871856 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.872616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.874706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:19.903466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1120/2268] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:19 2021] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:19.908727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:19.918987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3192dd-c3a5-4882-a028-b6081233a572 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:19.973983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:19.974648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:19.974947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:19.975204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:19.975904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:19.977871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:20.001403 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1149/2269] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:19 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:20.002612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:20.014299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb739-3a7f-495c-ba40-f7d98849b535 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:20.019146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:20.019837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:20.020145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:20.020437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:20.021807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:20.023486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:20.034012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1121/2270] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:20.038510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:20.048476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eaf3d-5c44-4ffa-9f35-1a157886a3ff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:20.053172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:20.053818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:20.054099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:20.054374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:20.055110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:20.056691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a7d5f-e843-48f1-899f-056551bc4cfe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:20.066263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1150/2271] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:20 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:20.070545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:20.080221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd344-5a49-46a7-9f75-2d0a194092a2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:20.085511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:20.086383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:20.086660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:20.086930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] PATH_INFO: `/v3/projects/ab05c733634740f7b463c26361ac8569/users/096e1eac19a644f6a9ac7b41ec8bb292/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:20.102775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab05c733634740f7b463c26361ac8569, user_id=096e1eac19a644f6a9ac7b41ec8bb292, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:20.105609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:20.119083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1122/2272] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:20 2021] PUT /identity/v3/projects/ab05c733634740f7b463c26361ac8569/users/096e1eac19a644f6a9ac7b41ec8bb292/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:20.134175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:20.134468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:20.134743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:20.160565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] MFA Rules not processed for user `096e1eac19a644f6a9ac7b41ec8bb292`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:20.162389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:20.221593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1151/2273] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:56:20 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:20.232710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:20.234622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:20.313394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc46cf-a626-45ad-9574-34a0f21c24d5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:20.317597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:20.318743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:20.319025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:20.319326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:20.329010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:20.330778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e6e31-e684-45c7-b016-c378e89d96db service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:20.341741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1123/2274] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:20 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:22.504821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:22.506368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:22.560068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b13a-337e-460b-a77c-723550c2a9a7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:22.563599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:22.564238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:22.564512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:22.564778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:22.566556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:22.625842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:22.627522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:22.637279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1152/2275] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:22 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:28.178889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:28.179341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:28.179426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:28.196262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:28.197733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:28.258360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1124/2276] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:56:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:28.271020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:28.272412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:28.339913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b2a67-2229-42e9-8e27-53aecdaaa551 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:28.345462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:28.346206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:28.346480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:28.346748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:28.356665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:28.358393 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a36e-0cc9-471f-9e97-b8b4fb911d0f service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:28.367920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1153/2277] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:56:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:56:29.437759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:29.500333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8e71-6663-4e0e-93da-2f73d4fac668 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:29.505009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:29.505862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:29.506136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:29.506403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] PATH_INFO: `/v3/users/096e1eac19a644f6a9ac7b41ec8bb292` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:29.507579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=096e1eac19a644f6a9ac7b41ec8bb292)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:29.509524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:29.561048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096e1eac19a644f6a9ac7b41ec8bb292'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:29.573997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096e1eac19a644f6a9ac7b41ec8bb292'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:29.580731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096e1eac19a644f6a9ac7b41ec8bb292'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:29.581595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096e1eac19a644f6a9ac7b41ec8bb292'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:29.582276 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096e1eac19a644f6a9ac7b41ec8bb292'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:29.594955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1125/2278] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:29 2021] DELETE /identity/v3/users/096e1eac19a644f6a9ac7b41ec8bb292 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:29.599659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:29.600192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:29.600192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:29.618318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:29.619517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:29.676564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1154/2279] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:56:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:29.687204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:29.688710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:29.751900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b3ff-f757-47dc-a34a-1e782c384afa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:29.755548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:29.756199 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:29.756526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:29.756757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:29.766384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:29.767808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb4870-c010-45c1-b821-3b5ff0bfa58b service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:29.777736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1126/2280] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:30.041611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:30.043150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:30.057553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065549c9-381e-4fb8-a461-d68732a21326 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:30.063894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:30.065107 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:30.065505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:30.065886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] PATH_INFO: `/v3/projects/ab05c733634740f7b463c26361ac8569` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:30.067229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab05c733634740f7b463c26361ac8569)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:30.081297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:30.131989 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab05c733634740f7b463c26361ac8569', 'request_id': 'req-45a66da5-3409-41ee-8753-318465e278e6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:30.141323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab05c733634740f7b463c26361ac8569', 'request_id': 'req-45a66da5-3409-41ee-8753-318465e278e6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:30.148379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab05c733634740f7b463c26361ac8569', 'request_id': 'req-45a66da5-3409-41ee-8753-318465e278e6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:30.158978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] The token cache is being invalidate because project ab05c733634740f7b463c26361ac8569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:30.159264 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:30.159896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:30.161457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1155/2281] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:30 2021] DELETE /identity/v3/projects/ab05c733634740f7b463c26361ac8569 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:58.666261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9d55-7044-4040-a7d0-a384880c9985 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.666774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9d55-7044-4040-a7d0-a384880c9985 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.666877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f9d55-7044-4040-a7d0-a384880c9985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.714079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-826f9d55-7044-4040-a7d0-a384880c9985 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:58.715311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-826f9d55-7044-4040-a7d0-a384880c9985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:58.781740 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1127/2282] 10.222.0.42 () {58 vars in 967 bytes} [Tue Oct 12 16:56:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:58.804735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:58.806188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:58.892598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66da5-3409-41ee-8753-318465e278e6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:58.897631 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:58.898265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.898547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.898821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.906891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:58.908498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:58.916721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1156/2283] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:56:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:57:48.202032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.202520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.202631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.220914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] MFA Rules not processed for user `71c73055c359426aa992230971e72a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:48.222150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:48.278012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1128/2284] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:53.762431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.764058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:53.834485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1596f-8d6e-48ac-b724-fe965ef94195 service swift] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.839303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.840205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.840507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.840802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] PATH_INFO: `/v3/users/78312c1ca69c421db29f35cd27ca7521` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.842285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78312c1ca69c421db29f35cd27ca7521)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.844190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.893205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78312c1ca69c421db29f35cd27ca7521'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:53.900820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78312c1ca69c421db29f35cd27ca7521'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:53.917959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78312c1ca69c421db29f35cd27ca7521'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:53.929893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78312c1ca69c421db29f35cd27ca7521'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:53.931746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-fb16ddc6-c3e5-49b5-b8de-efff4de6d37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78312c1ca69c421db29f35cd27ca7521'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:53.939307 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1157/2285] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:57:53 2021] DELETE /identity/v3/users/78312c1ca69c421db29f35cd27ca7521 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:54.122293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.135197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073700b-f801-443f-9ddc-82ea3df310fd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.189726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.190568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.190843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.191107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] PATH_INFO: `/v3/projects/02517e51abb14a7d8fdd8b67319cef69` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.192275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02517e51abb14a7d8fdd8b67319cef69)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.194172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.238043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02517e51abb14a7d8fdd8b67319cef69', 'request_id': 'req-5edbccb4-16fd-40e7-b073-ebc63c177e64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:54.244496 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02517e51abb14a7d8fdd8b67319cef69', 'request_id': 'req-5edbccb4-16fd-40e7-b073-ebc63c177e64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:54.249824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02517e51abb14a7d8fdd8b67319cef69', 'request_id': 'req-5edbccb4-16fd-40e7-b073-ebc63c177e64'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:54.261902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] The token cache is being invalidate because project 02517e51abb14a7d8fdd8b67319cef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:57:54.262190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:54.262820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5edbccb4-16fd-40e7-b073-ebc63c177e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:54.264362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1129/2286] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:57:54 2021] DELETE /identity/v3/projects/02517e51abb14a7d8fdd8b67319cef69 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:54.270209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.270495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.270768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.287883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:54.289135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:54.344890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1158/2287] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:54.354755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.355040 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.355316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.373490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:54.374694 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:54.384151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1130/2288] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:54.388380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.398021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62923512-a4f5-4bc3-aeaf-490a035b687e None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.403184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.403832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.404117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.404392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.405177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:57:54.405485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.407080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.419593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1159/2289] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:57:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:57:54.423983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.433244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222ee6-fe7d-495c-b355-aba3d8cb6261 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.437974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.438617 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.438899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.439174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.439918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.441850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.467044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1131/2290] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:54 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:54.471129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.481599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4171459-a677-4cbb-918d-a79f96ff3f93 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.538157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.538869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.539174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.540030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.540804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.542936 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.563451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1160/2291] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:54 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:54.567867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.581595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cdf5b-34e0-4a71-b73c-8dbf4bb3471d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.588641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.588641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.588641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.588641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.589859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.591033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.608082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1132/2292] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:54.609418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.621461 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6d7fe-997b-476f-95a4-541145cc6c82 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.627002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.627665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.627948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.628229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.629000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.630612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b516-f46c-43dd-83fd-cc535e2e9b21 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.642444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1161/2293] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:57:54.646514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.661849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f812-1205-4925-aebf-40c406a2a394 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.669552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.670512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.670804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.671087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] PATH_INFO: `/v3/projects/ab502ed6a57442038552831f9117a877/users/05c074dd037246f4b8f69e6e717ee260/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.691368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab502ed6a57442038552831f9117a877, user_id=05c074dd037246f4b8f69e6e717ee260, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.695367 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.712712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1133/2294] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:54 2021] PUT /identity/v3/projects/ab502ed6a57442038552831f9117a877/users/05c074dd037246f4b8f69e6e717ee260/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:57:54.718179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b8100-e2fd-43e8-9c22-d6301918a812 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.718470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b8100-e2fd-43e8-9c22-d6301918a812 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.718745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b8100-e2fd-43e8-9c22-d6301918a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.736399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-682b8100-e2fd-43e8-9c22-d6301918a812 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:54.737624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-682b8100-e2fd-43e8-9c22-d6301918a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:54.797894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1162/2295] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:54.807721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:54.809503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:54.866619 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8675f4-57a6-4056-88a8-da66ae8332e7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:54.870550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:54.871266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:54.871565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:54.871845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:54.881548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:54.883533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af84a2-18aa-40bc-9582-22a0acd8ec35 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:54.893421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1134/2296] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:55.507471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:55.507751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:55.508254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:55.534770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] MFA Rules not processed for user `05c074dd037246f4b8f69e6e717ee260`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:55.535967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:55.598775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1163/2297] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:55 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:55.610907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d738-4651-470e-bc9f-896016c4cfc4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:55.611440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d738-4651-470e-bc9f-896016c4cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:55.611672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d738-4651-470e-bc9f-896016c4cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:55.631165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1af6d738-4651-470e-bc9f-896016c4cfc4 None None] MFA Rules not processed for user `05c074dd037246f4b8f69e6e717ee260`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:55.632414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1af6d738-4651-470e-bc9f-896016c4cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:55.639595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1135/2298] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:57:55 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:55.650558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:55.651937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:55.746037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9bc1-3867-4e47-993c-e3a7ebc1a9e1 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:55.757248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:55.757907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:55.758220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:55.758501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:55.766713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:55.768288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:55.776955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1164/2299] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:55 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:06.176162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:06.177029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:06.185305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:06.204403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] MFA Rules not processed for user `d86e0624da9446b9a7bbffc277f18ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:06.205776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:06.263849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1136/2300] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:06 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:09.101369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:09.116446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83afc2-726f-42b6-8110-6c1483dd1711 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:09.121276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:09.121833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:09.122216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:09.122500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:09.124805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:09.143363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:09.144997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:09.158333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1165/2301] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:10.487838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:10.489318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:10.502755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3d06c-1613-4cc6-b43a-17d846d1b9a5 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:10.506465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:10.507336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:10.507584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:10.508007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:10.510150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:10.525206 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:10.526875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88133acf-c6f6-4742-8c56-7c38bace51b5 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:10.538696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1137/2302] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:14.274190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:14.285171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e442-111d-40f3-8f4b-3cc0be53ef65 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:14.291045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:14.291675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:14.292452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:14.292727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:14.294556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:14.351273 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:14.352973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:14.363085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1166/2303] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:14 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:16.482613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b0e5-add9-4a96-a799-19a5a56523a0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:16.483533 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b0e5-add9-4a96-a799-19a5a56523a0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:16.483815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65b0e5-add9-4a96-a799-19a5a56523a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:16.504744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-fb65b0e5-add9-4a96-a799-19a5a56523a0 None None] MFA Rules not processed for user `05c074dd037246f4b8f69e6e717ee260`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:16.506008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fb65b0e5-add9-4a96-a799-19a5a56523a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:16.514481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1138/2304] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:16 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:58:16.793885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:16.803769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb9389-8431-4298-902c-80534c6d558a service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:16.808233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:16.808812 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:16.809129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:16.809423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:16.811194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:16.821485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:16.822931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70470e-e193-419d-9d61-05dc13359c0e service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:16.833051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1167/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:17.141103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a58d-f905-4d67-9fb4-d7f182fd7a76 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:17.141412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a58d-f905-4d67-9fb4-d7f182fd7a76 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:17.141652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a58d-f905-4d67-9fb4-d7f182fd7a76 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:17.143434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1139/2306] 10.222.0.42 () {54 vars in 960 bytes} [Tue Oct 12 16:58:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:58:17.148933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:17.149251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:17.149527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:17.189908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] MFA Rules not processed for user `9df7a67d7326462582f66270c29c0fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:17.189908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:17.248855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1168/2307] 10.222.0.42 () {58 vars in 1057 bytes} [Tue Oct 12 16:58:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:17.257165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a58d-f905-4d67-9fb4-d7f182fd7a76 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:17.271302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a58d-f905-4d67-9fb4-d7f182fd7a76 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:17.276541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:17.277228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:17.277504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:17.277776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:17.279510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:17.290819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:17.292870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c243f6d-bf15-451d-afff-1673514fbf5a service placement] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:17.302467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1140/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:17 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:58:19.013608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:19.015069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:19.031295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90be91a-3dde-4b83-ba10-8eb7c522f1b6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:19.037981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:19.038851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:19.039294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:19.039721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:19.042004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:19.054981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:19.056592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:19.067373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1169/2309] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:19 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:21.836026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:21.836479 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:21.836570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:21.856191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:21.857442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:21.914424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1141/2310] 10.222.0.42 () {58 vars in 967 bytes} [Tue Oct 12 16:58:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:21.962617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:21.964591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:22.033869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be806f-13d0-4945-b2f6-2c2e9afb34cf service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:22.039022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:22.039657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:22.039939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:22.040251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:22.049110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:22.050688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79174c-18e3-415d-b4ea-49916fcb1968 service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:22.059683 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1170/2311] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:58:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:58:25.089421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:25.103228 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3bc21-a057-42f3-8403-83b744e018b2 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:25.110404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:25.111267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:25.111653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:25.112194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:25.114381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:25.127334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:25.128896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:25.137881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1142/2312] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:28.484801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:28.485395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:28.485395 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:28.503860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] MFA Rules not processed for user `05c074dd037246f4b8f69e6e717ee260`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:28.505373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:28.513289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1171/2313] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:28 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:29.186989 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:29.188137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:29.204438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874605b-09e7-47ee-93cb-830527725d10 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:29.209304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:29.210178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:29.210457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:29.210729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] PATH_INFO: `/v3/users/9cbdead697984cceaee20a14b5138e2f` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:29.212307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbdead697984cceaee20a14b5138e2f)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:29.214345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:29.271322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbdead697984cceaee20a14b5138e2f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.287508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbdead697984cceaee20a14b5138e2f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.295043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbdead697984cceaee20a14b5138e2f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.295758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbdead697984cceaee20a14b5138e2f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.296369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbdead697984cceaee20a14b5138e2f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.312208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1143/2314] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:58:29 2021] DELETE /identity/v3/users/9cbdead697984cceaee20a14b5138e2f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:29.506497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:29.518530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222b05-6f26-4270-9ff5-b5e70f00e7a7 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:29.584037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:29.584860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:29.585306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:29.585674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] PATH_INFO: `/v3/projects/c1d044dc68584dea8d9fffd7ebe10826` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:29.587180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d044dc68584dea8d9fffd7ebe10826)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:29.589724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:29.641402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d044dc68584dea8d9fffd7ebe10826', 'request_id': 'req-2ca0892e-f88f-4bfd-8978-0af555ac6862'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.649694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d044dc68584dea8d9fffd7ebe10826', 'request_id': 'req-2ca0892e-f88f-4bfd-8978-0af555ac6862'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.657943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d044dc68584dea8d9fffd7ebe10826', 'request_id': 'req-2ca0892e-f88f-4bfd-8978-0af555ac6862'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.671356 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] The token cache is being invalidate because project c1d044dc68584dea8d9fffd7ebe10826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:58:29.671647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.672318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.674244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1172/2315] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:58:29 2021] DELETE /identity/v3/projects/c1d044dc68584dea8d9fffd7ebe10826 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:29.677995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:29.679387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:29.697411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e307-2ade-4919-9a87-59192bc3f8ce admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:29.758337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:29.759130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:29.759411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:29.759686 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] PATH_INFO: `/v3/users/b9e680312b7642fb813c1e32d54022c1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:29.760960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e680312b7642fb813c1e32d54022c1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:29.762983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:29.819527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e680312b7642fb813c1e32d54022c1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.831132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e680312b7642fb813c1e32d54022c1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.837472 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e680312b7642fb813c1e32d54022c1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.838127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e680312b7642fb813c1e32d54022c1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.838751 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-49b9d6c4-846d-4acf-acdd-5301a6bdc393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e680312b7642fb813c1e32d54022c1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:29.851135 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1144/2316] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:58:29 2021] DELETE /identity/v3/users/b9e680312b7642fb813c1e32d54022c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:30.020426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.021919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:30.040622 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0892e-f88f-4bfd-8978-0af555ac6862 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.098562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.099436 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.099716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.099990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] PATH_INFO: `/v3/projects/7b12a249e4c544a693ff1a51a902e0cd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.101263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b12a249e4c544a693ff1a51a902e0cd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.103290 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.153591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b12a249e4c544a693ff1a51a902e0cd', 'request_id': 'req-45acd5e4-abc8-4631-a043-3ea8ea398fc8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:30.161589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b12a249e4c544a693ff1a51a902e0cd', 'request_id': 'req-45acd5e4-abc8-4631-a043-3ea8ea398fc8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:30.168910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b12a249e4c544a693ff1a51a902e0cd', 'request_id': 'req-45acd5e4-abc8-4631-a043-3ea8ea398fc8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:30.181118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] The token cache is being invalidate because project 7b12a249e4c544a693ff1a51a902e0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:58:30.181418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:30.182660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-45acd5e4-abc8-4631-a043-3ea8ea398fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:58:30.184241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1173/2317] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:58:30 2021] DELETE /identity/v3/projects/7b12a249e4c544a693ff1a51a902e0cd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:30.190155 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.190672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.190782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.210810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:30.212139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:30.294720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1145/2318] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:58:30.296808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.297305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.298000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.330562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:30.331789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:30.345213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.354511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1174/2319] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:30.358015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494263-ef86-4ebf-8e95-2da5747b860e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.363603 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.364440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.364725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.365036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.365869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:58:30.366181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.367795 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.382214 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1146/2320] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:58:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:58:30.386664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.399803 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdfa0d-27ea-4aa4-8a10-d09a2ae9c4ba None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.406608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.409128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.409128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.409128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.409128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.410549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.443306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1175/2321] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:58:30 2021] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:58:30.447885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.458565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706d12-59c6-4aae-885b-d14c61458ac2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.515798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.516362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.516644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.516920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.517656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.519562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.539739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1147/2322] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:58:30 2021] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:58:30.544469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.554582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346601c1-6459-4e4f-87b1-74fca17a1f60 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.559397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.560061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.560346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.560621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.561396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.562997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.575118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1176/2323] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:58:30.579221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.589370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170ad12-249a-4614-b744-77f1cb007bc1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.593980 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.594626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.594903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.595174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.596152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.597506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87a284-0c42-447a-bdac-4c3c833f0aaa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.609157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1148/2324] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:58:30.613278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.623366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacde8a-b02b-44fe-ae07-6be4bfb6df08 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.628342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.629241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.629519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.629789 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] PATH_INFO: `/v3/projects/a7fa28445b9049f88d60d9dc59087c60/users/0fb66c98af9c4aefaa046ab6fe2e54d3/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.644406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fa28445b9049f88d60d9dc59087c60, user_id=0fb66c98af9c4aefaa046ab6fe2e54d3, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.647064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.660976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1177/2325] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:58:30 2021] PUT /identity/v3/projects/a7fa28445b9049f88d60d9dc59087c60/users/0fb66c98af9c4aefaa046ab6fe2e54d3/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:30.666122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.666438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.666718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.684120 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:30.685378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:30.745415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1149/2326] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:58:30.755968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:30.757567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:30.818085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026fe5f-39ac-4cf6-bac2-0abd67fac4c6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:30.822199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:30.823642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:30.823886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:30.824159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:30.834250 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:30.835706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858d3e5-fd13-4aaf-be13-582891c034e1 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:30.848380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1178/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:31.637108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:31.638674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.736349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86250c-6479-48ec-b020-fcc907b0c00b None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:31.743957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:31.745611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:31.746478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:31.750929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:31.753333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.767005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:31.768861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:31.783842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1150/2328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:35.727983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:35.728508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:35.728605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:35.754747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] MFA Rules not processed for user `0fb66c98af9c4aefaa046ab6fe2e54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:35.756188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:35.828221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1179/2329] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:35 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:35.832627 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:35.843389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca78f-8949-4cc6-a21b-4b9b29d0884f service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:35.848075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:35.848724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:35.849039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:35.849316 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:35.850023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:35.851903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:35.884373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1151/2330] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:58:35 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:58:35.886212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:35.897101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda7462-b49d-4fff-842a-ab0e53e64e85 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:35.951154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:35.951829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:35.952269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:35.952392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:35.953181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:35.955135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:35.977483 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1180/2331] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:58:35 2021] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:58:35.983056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:35.994074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d604a4e-2307-47dc-8294-de105386506c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:35.998819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:35.999478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:35.999765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:36.000044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:36.001071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:36.002673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:36.018746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1152/2332] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:58:35 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:58:36.019996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:36.036611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859364-9d87-4dc6-91de-c666cb174762 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:36.041418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:36.042331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:36.042606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:36.042874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] PATH_INFO: `/v3/projects/f5be202cae47470fa69ceab5209c8f6b/users/2dbda78908b44bec9586b17f71e6006f/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:36.057860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5be202cae47470fa69ceab5209c8f6b, user_id=2dbda78908b44bec9586b17f71e6006f, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:36.060513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:36.075581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1181/2333] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:58:36 2021] PUT /identity/v3/projects/f5be202cae47470fa69ceab5209c8f6b/users/2dbda78908b44bec9586b17f71e6006f/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:36.079512 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:36.090691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa8b68-6d7f-4053-bef2-be401f308702 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:36.153368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:36.153967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:36.154262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:36.154535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:36.155283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:36.156879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b9710-4368-4488-b6c1-9fef0783fa16 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:36.167505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1153/2334] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:58:36 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:58:36.171317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:36.183933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f880-aa91-4696-b3d4-0fbc19192051 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:36.189524 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:36.190514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:36.190692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:36.190962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] PATH_INFO: `/v3/projects/f5be202cae47470fa69ceab5209c8f6b/users/2dbda78908b44bec9586b17f71e6006f/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:36.195204 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5be202cae47470fa69ceab5209c8f6b, user_id=2dbda78908b44bec9586b17f71e6006f, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:36.198834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:36.229068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1182/2335] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:58:36 2021] PUT /identity/v3/projects/f5be202cae47470fa69ceab5209c8f6b/users/2dbda78908b44bec9586b17f71e6006f/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:58:41.422959 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f94db-92b5-4587-8832-ad2ad9badd12 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:41.423507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f94db-92b5-4587-8832-ad2ad9badd12 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:41.423507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f94db-92b5-4587-8832-ad2ad9badd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:41.454205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ad1f94db-92b5-4587-8832-ad2ad9badd12 None None] MFA Rules not processed for user `2dbda78908b44bec9586b17f71e6006f`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:41.455418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ad1f94db-92b5-4587-8832-ad2ad9badd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:41.547270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1154/2336] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:41 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:58:41.559790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:41.561575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:41.643785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfcbb3-a498-49fb-8224-bc9e6561ba98 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:41.652575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:41.653581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:41.654017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:41.654380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:41.716829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:41.718647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:41.728430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1183/2337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:41 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:52.191248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290334ed-dae2-4f5b-9aff-b6cdfb43dedf None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:52.191815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290334ed-dae2-4f5b-9aff-b6cdfb43dedf None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:52.191815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290334ed-dae2-4f5b-9aff-b6cdfb43dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:52.209080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-290334ed-dae2-4f5b-9aff-b6cdfb43dedf None None] MFA Rules not processed for user `05c074dd037246f4b8f69e6e717ee260`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:52.210281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-290334ed-dae2-4f5b-9aff-b6cdfb43dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:52.268722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1155/2338] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:58:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:52.539232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:52.540790 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:52.598779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc36a-d9b3-4536-8c1d-e4861939ac2a service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:52.603394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:52.604214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:52.604494 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:52.604767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:52.606580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:52.621947 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:52.623882 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874d85d-d4e8-4ede-a916-9375c6d099d4 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:52.632460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1184/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:58.195902 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6760-3582-4e7d-bb29-087573b45748 None None] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:58.196825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6760-3582-4e7d-bb29-087573b45748 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:58.197146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb6760-3582-4e7d-bb29-087573b45748 None None] PATH_INFO: `/` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:58.200023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1156/2340] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:58:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:58:58.210665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:58.211084 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:58.211194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:58.242034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] MFA Rules not processed for user `aa9eafe94021438cbcdae8466277f9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:58.243934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:58.254639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1185/2341] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:58:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:58.272622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb6760-3582-4e7d-bb29-087573b45748 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:58.283624 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb6760-3582-4e7d-bb29-087573b45748 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:58.288641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:58.289580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:58.290068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:58.290561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:58.300436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:58.302242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c075c-610a-4bec-bf25-6c3ad63b582d service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:58.325187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1157/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:58 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:01.071014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:01.085375 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465c78c-704f-48da-83a7-e3c28167baab None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:01.090829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:01.091466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:01.091749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:01.092026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:01.093813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:01.106499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:01.108353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce91e-aab5-416a-b4d5-c64aa7e4e3c8 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:01.121222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1186/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:08.835541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:08.836029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:08.836134 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:08.855077 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] MFA Rules not processed for user `0fb66c98af9c4aefaa046ab6fe2e54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:08.856290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:08.863622 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1158/2344] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:08 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:17.627360 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:17.627939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:17.627939 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:17.646413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:17.647626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:17.702825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1187/2345] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:59:17 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:59:17.717572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:17.719307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:17.794561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539b62-4b40-4c00-a691-b4454c8d227e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:17.799954 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:17.800611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:17.800895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:17.801239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:17.811082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:17.812700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:17.821499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1159/2346] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:59:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:59:28.668560 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:28.679067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92646741-b6e2-43eb-bb38-daea8490f44c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:28.683444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:28.684380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:28.684760 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:28.685106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:28.695145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:28.697072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4199a37-1a6f-43d9-a1f7-9f7b9b4fb161 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:28.708078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1188/2347] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:28 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:30.715986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:30.728311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7f78-97c4-4b68-8e56-53ad8bf5e411 service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:30.734757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:30.735393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:30.735673 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:30.735943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:30.737773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:30.749957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:30.751719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6b815-1e6a-4cc8-8476-491d1d39beef service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:30.762227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1160/2348] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:32.533219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:32.534184 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:32.534661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] PATH_INFO: `/` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:32.536497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1189/2349] 10.222.0.42 () {54 vars in 921 bytes} [Tue Oct 12 16:59:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:59:32.543279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f7c0-eb21-41f2-825b-255d01f598f0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:32.543867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f7c0-eb21-41f2-825b-255d01f598f0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:32.544082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f7c0-eb21-41f2-825b-255d01f598f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:32.590116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5634f7c0-eb21-41f2-825b-255d01f598f0 None None] MFA Rules not processed for user `d0942cb70c474b06a9ea51db2f3298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:32.591398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5634f7c0-eb21-41f2-825b-255d01f598f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:32.601748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1161/2350] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Oct 12 16:59:32 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:32.614728 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:32.616690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:32.697095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4b57-7fcd-49bc-b6c9-711d542ab86b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:32.701292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:32.701928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:32.702210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:32.702484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:32.712618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:32.714109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:32.725329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1190/2351] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:34.404249 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:34.404771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:34.404866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:34.424364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:34.425810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:34.441659 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1162/2352] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Oct 12 16:59:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:34.455479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:34.466815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a784a02-517e-48a1-b6be-55a121746984 service glance] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:34.475707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:34.476536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:34.476821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:34.477142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:34.493279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:34.494913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:34.505245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1191/2353] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:59:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:59:51.340457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:51.342500 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:51.417832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aef69-40bc-46f5-ab0b-7b1f4fa64995 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:51.423466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:51.424418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:51.424806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:51.425191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] PATH_INFO: `/v3/users/05c074dd037246f4b8f69e6e717ee260` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:51.426520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c074dd037246f4b8f69e6e717ee260)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:51.428529 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:51.485871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c074dd037246f4b8f69e6e717ee260'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.498804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c074dd037246f4b8f69e6e717ee260'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.508743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c074dd037246f4b8f69e6e717ee260'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.509597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c074dd037246f4b8f69e6e717ee260'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.510909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-8fef2e2b-e058-4387-8cdb-f0e0006ce687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c074dd037246f4b8f69e6e717ee260'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.527236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1163/2354] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:51 2021] DELETE /identity/v3/users/05c074dd037246f4b8f69e6e717ee260 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:51.733835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:51.744439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90f29-ef00-423e-81c8-c7bd0a5ddd07 service swift] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:51.802833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:51.803688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:51.803970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:51.804246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] PATH_INFO: `/v3/projects/ab502ed6a57442038552831f9117a877` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:51.805500 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab502ed6a57442038552831f9117a877)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:51.807553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:51.852186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab502ed6a57442038552831f9117a877', 'request_id': 'req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.859644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab502ed6a57442038552831f9117a877', 'request_id': 'req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.865664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab502ed6a57442038552831f9117a877', 'request_id': 'req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.876192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] The token cache is being invalidate because project ab502ed6a57442038552831f9117a877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:51.876475 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.877137 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-bc748906-3e46-4ce6-b6b1-432cd16c8c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:51.878642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1192/2355] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:51 2021] DELETE /identity/v3/projects/ab502ed6a57442038552831f9117a877 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:51.884798 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:51.885126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:51.885407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:51.902760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:51.904132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:51.963229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1164/2356] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:51.971036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:51.971322 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:51.971593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:51.989845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:51.990969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:51.998825 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1193/2357] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:52.003706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.013287 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1b43d-8e3f-45ce-a32c-07af676a36ef None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.017911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.018672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.018953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.019220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.019966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:59:52.020268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.021882 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.033081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1165/2358] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:59:52.037309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.046907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01a02-424e-4710-9878-2038e84b7a4a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.051782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.052425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.052704 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.053029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.053725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.055624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.089639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1194/2359] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:52.093802 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.103872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f631-47fd-4e48-87ff-6f4030460668 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.157078 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.157744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.158026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.158299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.159004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.160905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.180343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1166/2360] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/users => generated 303 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:59:52.184481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.195301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3a9da-fedf-4e24-9e70-d084144b8508 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.200058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.200842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.201158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.201440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.202224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.203996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.213756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1195/2361] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:52.218239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.227934 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cacb-1d18-4005-a7ad-feae0c4d67b6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.232597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.233866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.234151 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.234424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.235156 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.236732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7dfcd-f7f3-4e27-a5fa-06fee038a56f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.246803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1167/2362] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:52.250959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.260638 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c2865-76f1-4b9f-bed4-a925903272df admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.265345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.266217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.266499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.266774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] PATH_INFO: `/v3/projects/8feeb98097054bcbb9e8c44723ae9ee5/users/3ee2d831c61244b888a5c5d9bb16b75c/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.281493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8feeb98097054bcbb9e8c44723ae9ee5, user_id=3ee2d831c61244b888a5c5d9bb16b75c, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.284142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.297176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1196/2363] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:52 2021] PUT /identity/v3/projects/8feeb98097054bcbb9e8c44723ae9ee5/users/3ee2d831c61244b888a5c5d9bb16b75c/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:52.308056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.308460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.308803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.335910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] MFA Rules not processed for user `3ee2d831c61244b888a5c5d9bb16b75c`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:52.337149 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:52.404122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1168/2364] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:52.408928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.473261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ec495-64ab-427f-b4f2-73f5e57474e5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.478037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.478697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.478977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.479261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.479970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.481908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.507349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1197/2365] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:52.511990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.523067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ab8b-b53e-4003-9db1-d79c688ccaf1 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.576913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.578278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.578564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.578837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.579640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.581535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.603749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1169/2366] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:52.607750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.619173 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b1fa7-9caa-4308-8ae0-a8eab2fe6bb6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.624904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.625966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.626246 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.626516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.627274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.628875 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.642564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1198/2367] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:59:52.643780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.653939 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b610d-f8c2-4ddc-8c20-e1093ad951ba admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.658912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.659819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.660119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.660391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] PATH_INFO: `/v3/projects/da3834e126244dc8bd722b69d264aa1d/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.675840 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3834e126244dc8bd722b69d264aa1d, user_id=f3ee2c521ab54f0bbfe1ef7c3f4a7f19, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.678650 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.691892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1170/2368] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:52 2021] PUT /identity/v3/projects/da3834e126244dc8bd722b69d264aa1d/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:52.696073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.706930 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6bbb1-ce85-4a28-8739-10e2eb8645dc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.763715 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.764364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.765081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.765358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.766091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.767691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778e399-bc54-4d2f-9c9d-a18863d9fc0e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.777177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1199/2369] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:52.782026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.791975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441ce8-c448-45e5-8c28-724cc9848d5f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.796750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.797642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.797924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.798193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] PATH_INFO: `/v3/projects/da3834e126244dc8bd722b69d264aa1d/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.800158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3834e126244dc8bd722b69d264aa1d, user_id=f3ee2c521ab54f0bbfe1ef7c3f4a7f19, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:52.802841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:52.812765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1171/2370] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:52 2021] PUT /identity/v3/projects/da3834e126244dc8bd722b69d264aa1d/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:59:52.823167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.823167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.823167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.849627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] MFA Rules not processed for user `f3ee2c521ab54f0bbfe1ef7c3f4a7f19`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:52.850834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:52.917971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1200/2371] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:52 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:52.928032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:52.929731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:52.984670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50d841-607e-40d7-ac51-d60db59e57fa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:52.988546 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:52.989210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:52.989497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:52.989768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:52.999304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.001006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7acdb7-618f-468a-b08f-28edfc44e8bc service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:53.014057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1172/2372] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:52 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:53.141702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:53.171390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.171754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.172101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.191203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] MFA Rules not processed for user `a14e56830d1145278d5012377b283e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:53.192541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.206548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7125-c539-4ef0-9748-4b1dead4d309 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:53.212753 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:53.213802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.214083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.214357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] PATH_INFO: `/v3/users/3ee2d831c61244b888a5c5d9bb16b75c` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.215619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee2d831c61244b888a5c5d9bb16b75c)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.217983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:53.249704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1173/2373] 10.222.0.42 () {58 vars in 967 bytes} [Tue Oct 12 16:59:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:59:53.266912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:53.268524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.276590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee2d831c61244b888a5c5d9bb16b75c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.285288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee2d831c61244b888a5c5d9bb16b75c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.296625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee2d831c61244b888a5c5d9bb16b75c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.304912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee2d831c61244b888a5c5d9bb16b75c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.305674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-db57ad46-a491-41cd-9cfd-604be28d3630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee2d831c61244b888a5c5d9bb16b75c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.313103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1201/2374] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:53 2021] DELETE /identity/v3/users/3ee2d831c61244b888a5c5d9bb16b75c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:53.317285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.317644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.317985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.338454 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769867b-8091-4f94-a8d2-b7f0e0450ed7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:53.341167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:53.342372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.397720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3be860ad77f429ab00e7ce038b7c735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:53.398364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.398765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.399066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.400860 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.402717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1202/2375] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:59:53.414597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:53.416065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.460796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.462444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:53.470941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1174/2376] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Oct 12 16:59:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:59:53.473154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d982ef-4c0d-48dc-b8bf-aab82507036b None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:53.477214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:53.477859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.478139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.478409 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.489008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.490450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:53.501512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1203/2377] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:59:53.806326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:53.808691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:53.829188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd880e-4753-402b-84d9-9830077bc18c service swift] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:53.838262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:53.839033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.839315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.839588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] PATH_INFO: `/v3/projects/8feeb98097054bcbb9e8c44723ae9ee5` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.841286 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8feeb98097054bcbb9e8c44723ae9ee5)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.844962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:53.895660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8feeb98097054bcbb9e8c44723ae9ee5', 'request_id': 'req-22979a83-e455-4ded-a342-b7e417014310'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.902707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8feeb98097054bcbb9e8c44723ae9ee5', 'request_id': 'req-22979a83-e455-4ded-a342-b7e417014310'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.909427 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8feeb98097054bcbb9e8c44723ae9ee5', 'request_id': 'req-22979a83-e455-4ded-a342-b7e417014310'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.923439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] The token cache is being invalidate because project 8feeb98097054bcbb9e8c44723ae9ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:53.923730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.924352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:53.925922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1175/2378] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:53 2021] DELETE /identity/v3/projects/8feeb98097054bcbb9e8c44723ae9ee5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:53.929920 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:53.939363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7273-3001-492f-a51e-5d17c332ca1e service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:53.994934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:53.995830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:53.996114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:53.996389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] PATH_INFO: `/v3/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:53.997615 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ee2c521ab54f0bbfe1ef7c3f4a7f19)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:53.999534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.049279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ee2c521ab54f0bbfe1ef7c3f4a7f19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.057527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ee2c521ab54f0bbfe1ef7c3f4a7f19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.070189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ee2c521ab54f0bbfe1ef7c3f4a7f19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.077647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ee2c521ab54f0bbfe1ef7c3f4a7f19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.078538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3688818e-30e5-4188-9c22-7a3174bafddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ee2c521ab54f0bbfe1ef7c3f4a7f19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.085130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1204/2379] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:53 2021] DELETE /identity/v3/users/f3ee2c521ab54f0bbfe1ef7c3f4a7f19 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:54.352790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.355074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:54.372308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22979a83-e455-4ded-a342-b7e417014310 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.437237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.438108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.438379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.438645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] PATH_INFO: `/v3/projects/da3834e126244dc8bd722b69d264aa1d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.439853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3834e126244dc8bd722b69d264aa1d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.441771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.489205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3834e126244dc8bd722b69d264aa1d', 'request_id': 'req-f7c435f3-7569-438a-8f28-52e65b122eaf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.495116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3834e126244dc8bd722b69d264aa1d', 'request_id': 'req-f7c435f3-7569-438a-8f28-52e65b122eaf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.500322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3834e126244dc8bd722b69d264aa1d', 'request_id': 'req-f7c435f3-7569-438a-8f28-52e65b122eaf'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.512297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] The token cache is being invalidate because project da3834e126244dc8bd722b69d264aa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:54.512601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.513260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-f7c435f3-7569-438a-8f28-52e65b122eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:54.514829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1176/2380] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:54 2021] DELETE /identity/v3/projects/da3834e126244dc8bd722b69d264aa1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:54.520532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.520818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.521139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.538682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:54.539945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:54.596913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1205/2381] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:54.605288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.605288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.605578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.623728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:54.624972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:54.633536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1177/2382] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:54.637896 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.648038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5bdb-2ec5-4110-a73c-a9c3d2827c83 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.653299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.654097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.654378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.654636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.655903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:59:54.656211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.657856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.673888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1206/2383] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:59:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:59:54.675017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.684476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd51d1-a035-4ef9-b76e-202b066009bb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.689433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.690093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.690372 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.690644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.691343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.693264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.721674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1178/2384] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:54 2021] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:59:54.726105 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.736795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990e6b-dfd8-4d5c-aca0-11ee7c0d1934 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.793102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.793673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.793955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.794231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.794931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.797578 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.816774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1207/2385] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:54 2021] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:59:54.821008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.831566 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b616d-38fb-4cd8-8265-6ee4c2500221 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.836100 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.836742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.837050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.837322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.838075 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.839664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.850379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1179/2386] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:54.854222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.864251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99161-926c-4495-adf1-ac19f120a6d4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.869057 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.869717 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.870003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.870281 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.871020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.872613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa2543-66fe-48dd-aa07-a576159a7847 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.882966 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1208/2387] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:59:54.887184 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:54.897666 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc911bf9-c33e-45a5-9ca0-90f67283cb6b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:54.902665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:54.903545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.903829 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.904136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] PATH_INFO: `/v3/projects/8c35f71ea1384a2dbdf654c2994f155b/users/d0852f0fd0c945719f2b1dc992f18b06/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.919621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c35f71ea1384a2dbdf654c2994f155b, user_id=d0852f0fd0c945719f2b1dc992f18b06, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:54.922328 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:54.937915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1180/2388] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:54 2021] PUT /identity/v3/projects/8c35f71ea1384a2dbdf654c2994f155b/users/d0852f0fd0c945719f2b1dc992f18b06/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:54.943344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e582b4-4555-4f9a-ad51-0028cf221f84 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:54.943860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e582b4-4555-4f9a-ad51-0028cf221f84 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:54.943946 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e582b4-4555-4f9a-ad51-0028cf221f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:54.963064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d4e582b4-4555-4f9a-ad51-0028cf221f84 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:54.964389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d4e582b4-4555-4f9a-ad51-0028cf221f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:55.031156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1209/2389] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:59:55.041003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:55.042714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:55.098688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fddf00-01a9-44fe-be5f-bc1a6f85288c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:55.102329 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:55.102967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:55.103246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:55.103518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:55.112300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:55.113844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:55.123339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1181/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 16:59:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:59:55.739795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:55.740174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:55.740541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:55.767240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] MFA Rules not processed for user `d0852f0fd0c945719f2b1dc992f18b06`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:55.768450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:55.832466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1210/2391] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:55 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:55.836905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:55.846892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe83b67-5d42-477e-8ab0-04eaf2fcfc41 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:55.851554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:55.852203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:55.852484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:55.852764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:55.853514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:55.855410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:55.885209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1182/2392] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:55 2021] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:55.886509 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:55.897245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e30f44-bace-4f5a-94c7-c9c47753b0af None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:55.950915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:55.951616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:55.952344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:55.952618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:55.953361 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:55.955301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:55.976172 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1211/2393] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:55 2021] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:55.980256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:55.990466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4fce-40ba-4d2c-bc2a-662e2f527035 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:55.995074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:55.995721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:55.995999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:55.996269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:55.997031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:55.998606 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:56.009814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1183/2394] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:56.013863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:56.024607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545475b-a2ea-492b-8722-b3542fd2244d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:56.029342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:56.030726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:56.031003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:56.031302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] PATH_INFO: `/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af/users/57bf3bd90e0c48f29c90516002ddf5b7/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:56.048816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c30cce7b0d4fd59c1543693f96a8af, user_id=57bf3bd90e0c48f29c90516002ddf5b7, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:56.051651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:56.065567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1212/2395] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:56 2021] PUT /identity/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af/users/57bf3bd90e0c48f29c90516002ddf5b7/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:59:56.069672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:56.083339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050cb96-ee11-45f3-a28a-4d8b6fabc0a3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:56.136752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:56.137629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:56.137916 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:56.138193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:56.138932 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:56.140524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f17d4-5783-44a8-8221-3fdfe7be5165 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:56.150703 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1184/2396] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:56 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:59:56.154883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:56.166160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9d0b-c055-4932-adcf-71153a1da91e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:56.171651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:56.172545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:56.172827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:56.173142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] PATH_INFO: `/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af/users/57bf3bd90e0c48f29c90516002ddf5b7/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:56.175151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c30cce7b0d4fd59c1543693f96a8af, user_id=57bf3bd90e0c48f29c90516002ddf5b7, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:56.177834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:56.188599 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1213/2397] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:56 2021] PUT /identity/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af/users/57bf3bd90e0c48f29c90516002ddf5b7/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:56.814219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:56.814640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:56.815079 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:56.844242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] MFA Rules not processed for user `57bf3bd90e0c48f29c90516002ddf5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:56.845502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:56.915585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1185/2398] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:56 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:57.909598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:57.980993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07e83-983a-4a19-a2ea-96e00e550c41 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:57.986128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:57.987233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:57.987376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:57.987543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] PATH_INFO: `/v3/users/d0852f0fd0c945719f2b1dc992f18b06` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:57.988735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0852f0fd0c945719f2b1dc992f18b06)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:57.990700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:58.039817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0852f0fd0c945719f2b1dc992f18b06'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.047352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0852f0fd0c945719f2b1dc992f18b06'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.058799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0852f0fd0c945719f2b1dc992f18b06'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.065340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0852f0fd0c945719f2b1dc992f18b06'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.065999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0852f0fd0c945719f2b1dc992f18b06'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.071833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1214/2399] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:57 2021] DELETE /identity/v3/users/d0852f0fd0c945719f2b1dc992f18b06 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:58.241901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:58.253288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d87a5-14bc-416e-a4a9-4a7125a67951 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:58.307284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:58.308153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:58.308434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:58.308708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] PATH_INFO: `/v3/projects/8c35f71ea1384a2dbdf654c2994f155b` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:58.309985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c35f71ea1384a2dbdf654c2994f155b)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:58.312411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:58.358499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c35f71ea1384a2dbdf654c2994f155b', 'request_id': 'req-63d77326-1355-44c9-8009-a286460aff0a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.364402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c35f71ea1384a2dbdf654c2994f155b', 'request_id': 'req-63d77326-1355-44c9-8009-a286460aff0a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.369768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c35f71ea1384a2dbdf654c2994f155b', 'request_id': 'req-63d77326-1355-44c9-8009-a286460aff0a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.382681 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] The token cache is being invalidate because project 8c35f71ea1384a2dbdf654c2994f155b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:58.382965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.383573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.385130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1186/2400] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:58 2021] DELETE /identity/v3/projects/8c35f71ea1384a2dbdf654c2994f155b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:58.390156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:58.391630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:58.404689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625cc8-69d9-44a4-a36d-ffd1de044924 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:58.461589 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:58.462484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:58.462768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:58.463043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] PATH_INFO: `/v3/users/57bf3bd90e0c48f29c90516002ddf5b7` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:58.464252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bf3bd90e0c48f29c90516002ddf5b7)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:58.466320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:58.512535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bf3bd90e0c48f29c90516002ddf5b7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.521227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bf3bd90e0c48f29c90516002ddf5b7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.532795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bf3bd90e0c48f29c90516002ddf5b7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.539231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bf3bd90e0c48f29c90516002ddf5b7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.539898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-775137f5-a827-4eff-8bc8-d798dbf18311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bf3bd90e0c48f29c90516002ddf5b7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.545826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1215/2401] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:58 2021] DELETE /identity/v3/users/57bf3bd90e0c48f29c90516002ddf5b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:58.714394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:58.716522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:58.733337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d77326-1355-44c9-8009-a286460aff0a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:58.793081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:58.793857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:58.794136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:58.794432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] PATH_INFO: `/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:58.796168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c30cce7b0d4fd59c1543693f96a8af)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:58.798118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:58.843962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c30cce7b0d4fd59c1543693f96a8af', 'request_id': 'req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.849942 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c30cce7b0d4fd59c1543693f96a8af', 'request_id': 'req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.855153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c30cce7b0d4fd59c1543693f96a8af', 'request_id': 'req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.868357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] The token cache is being invalidate because project c3c30cce7b0d4fd59c1543693f96a8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:58.868770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.869607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-d0ed55c0-8071-4357-8e67-a74c24a5ebd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:58.871300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1187/2402] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:58 2021] DELETE /identity/v3/projects/c3c30cce7b0d4fd59c1543693f96a8af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:59:58.878147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:58.878431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:58.878702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:58.895608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:58.896817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:58.953251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1216/2403] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:58.961478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:58.961765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:58.962041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:58.980311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:58.981609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:58.989724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1188/2404] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:58.993965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.004365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc8822-d02e-42e0-8bb8-79aeab6c63fd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.009469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.010119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.010404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.010679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.011450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:59:59.011754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.013369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.025724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1217/2405] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 16:59:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:59:59.029772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.039009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd2ef-a628-4f2d-9d5c-c682d0c1532f None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.044027 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.044599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.044875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.045182 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.045898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.047806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.076816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1189/2406] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:59.078443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.088129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65907e3-ea7e-4906-8313-5d07e6f20a90 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.150124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.150795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.151075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.151347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.152048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.153984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.173447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1218/2407] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:59.177545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.188586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e7f9-6139-498b-9041-672884dbfe50 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.193031 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.193688 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.193968 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.194241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.194977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.196839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.208985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1190/2408] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:59.212038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.222933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bf5d-cb41-4032-8b49-b2c3509f9211 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.228161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.228824 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.229142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.229405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.230197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.231763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c30b-783e-4893-9277-6cefe6deed42 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.242226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1219/2409] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:59.246826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.257609 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4eaac-8f95-4efb-8201-65e22cc54d6b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.262547 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.263502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.263785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.264055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] PATH_INFO: `/v3/projects/fedea74313814865b1f4a7d49fba2b63/users/f9d4a4f023304918a9396ed9cfb0fb7f/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.279817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedea74313814865b1f4a7d49fba2b63, user_id=f9d4a4f023304918a9396ed9cfb0fb7f, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.282553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.296061 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1191/2410] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:59 2021] PUT /identity/v3/projects/fedea74313814865b1f4a7d49fba2b63/users/f9d4a4f023304918a9396ed9cfb0fb7f/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:59.309200 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.309573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.309923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.337474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] MFA Rules not processed for user `f9d4a4f023304918a9396ed9cfb0fb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:59.338680 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:59.403853 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1220/2411] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:59.408549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.477311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dbe8b-e16a-472a-968d-b88d958998f2 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.482004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.482660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.482947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.483711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.484411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.486353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.513908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1192/2412] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:59:59.517961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.528558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26717-4155-417e-b313-aaa312aa0e54 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.583008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.583675 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.583954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.584227 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.584935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.586873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.606233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1221/2413] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:59.610773 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.621006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423d6a-0496-4ce0-89da-021b23a73cf5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.626487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.627138 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.627412 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.627678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.628398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.630195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.640754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1193/2414] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:59.645129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.654977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1fd7-9de6-49b7-8a17-a075c7f945cf admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.659588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.660231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.660513 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.660786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.661562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.663149 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28600a-1075-4637-8946-86045a6f7c7a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.673272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1222/2415] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 16:59:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:59:59.677431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.687674 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d31d2b-c430-4a63-a4bc-9a68fd09f077 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.693862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.695068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.695342 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.695613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] PATH_INFO: `/v3/projects/6b52ba5876f14011bb4b4be8714b00a6/users/ec64eaf24f8f4a7fbe3230b04bc4b8fe/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.710327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b52ba5876f14011bb4b4be8714b00a6, user_id=ec64eaf24f8f4a7fbe3230b04bc4b8fe, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.713007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.725629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1194/2416] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 16:59:59 2021] PUT /identity/v3/projects/6b52ba5876f14011bb4b4be8714b00a6/users/ec64eaf24f8f4a7fbe3230b04bc4b8fe/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:59.735768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.736088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.736364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.762636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] MFA Rules not processed for user `ec64eaf24f8f4a7fbe3230b04bc4b8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:59:59.763843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:59.824182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1223/2417] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:59:59.828779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.885991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817a0e-374c-47f4-b3cc-a258c4d96387 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.890634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.891280 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.891554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.891824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.892504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.894403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:59.918127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1195/2418] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:59:59.922833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:59.933545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77533-0aa6-4879-99f0-7d123f66618f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:59.987569 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:59.988213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:59.988499 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:59.988775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:59.989516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:59.991433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.012017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1224/2419] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 16:59:59 2021] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:00.016437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.027262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a682dc0-9dbf-4c7a-a7a5-cb1685eb6c58 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.032383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.033070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.033353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.033628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.034355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.036237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.047174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1196/2420] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:00.051444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.061245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febbbd2-b1d0-459e-96f4-196dad96a7ff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.065792 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.066654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.066932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.067205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] PATH_INFO: `/v3/projects/a94eaef359104dd1ac75356d2a9a8331/users/23cf8368a73340ecb57aaedb19393856/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.081611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94eaef359104dd1ac75356d2a9a8331, user_id=23cf8368a73340ecb57aaedb19393856, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.084161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.096424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1225/2421] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:00 2021] PUT /identity/v3/projects/a94eaef359104dd1ac75356d2a9a8331/users/23cf8368a73340ecb57aaedb19393856/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:00.100344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.110539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d1a5-c9aa-48dc-8353-ed6d9df47402 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.163844 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.164507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.165141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.165423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.166148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.167730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c0398-4b0d-4332-be96-4908f0430cc3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.177985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1197/2422] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:00.182065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.192997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fccfd-f107-4ecb-abe0-1a6837161148 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.197651 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.198551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.198827 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.199117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] PATH_INFO: `/v3/projects/a94eaef359104dd1ac75356d2a9a8331/users/23cf8368a73340ecb57aaedb19393856/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.201124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94eaef359104dd1ac75356d2a9a8331, user_id=23cf8368a73340ecb57aaedb19393856, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.203756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.213690 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1226/2423] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:00 2021] PUT /identity/v3/projects/a94eaef359104dd1ac75356d2a9a8331/users/23cf8368a73340ecb57aaedb19393856/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:00.224810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.225198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.225481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.251978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] MFA Rules not processed for user `23cf8368a73340ecb57aaedb19393856`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:00.253211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:00.318914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1198/2424] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:00 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:00.329298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.331005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:00.385997 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b5a24-b66b-47fe-8980-f3644b5890d5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.389634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.390270 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.390552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.390829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.401881 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.403331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.413231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1227/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:00 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:00.454037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:00.455464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:00.467145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b655e9-5ca0-4316-8cbf-24def92dc763 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:00.471326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:00.471955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:00.472245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:00.472518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:00.526797 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:00.528281 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c1e73-af6f-4f51-a683-963729b0db31 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:00.537745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1199/2426] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:00 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:03.382134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:03.463275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06098c5-350a-46c0-9c75-7d5826150576 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:03.469440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:03.470346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:03.470637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:03.470911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] PATH_INFO: `/v3/users/f9d4a4f023304918a9396ed9cfb0fb7f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:03.472180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d4a4f023304918a9396ed9cfb0fb7f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:03.474183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:03.534158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d4a4f023304918a9396ed9cfb0fb7f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:03.542824 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d4a4f023304918a9396ed9cfb0fb7f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:03.556374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d4a4f023304918a9396ed9cfb0fb7f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:03.563633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d4a4f023304918a9396ed9cfb0fb7f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:03.564367 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d4a4f023304918a9396ed9cfb0fb7f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:03.571062 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1228/2427] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:03 2021] DELETE /identity/v3/users/f9d4a4f023304918a9396ed9cfb0fb7f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:03.575549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:03.576437 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:03.577475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:03.595573 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:03.596812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:03.669107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1200/2428] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:03.678535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:03.680064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:03.741705 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255a22-3292-4454-ba3f-ed888cf0eea9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:03.745689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:03.746346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:03.746642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:03.746905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:03.758565 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:03.759995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:03.773379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1229/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:04.057863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:04.059970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:04.078698 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eb0b2-d794-4f71-af4f-9c67c9afa8e9 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:04.083613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:04.084480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:04.084757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:04.085054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] PATH_INFO: `/v3/projects/fedea74313814865b1f4a7d49fba2b63` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:04.087199 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedea74313814865b1f4a7d49fba2b63)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:04.089332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:04.135432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedea74313814865b1f4a7d49fba2b63', 'request_id': 'req-877c5b80-6443-4174-acf5-ac1494580c8c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.141812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedea74313814865b1f4a7d49fba2b63', 'request_id': 'req-877c5b80-6443-4174-acf5-ac1494580c8c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.146900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedea74313814865b1f4a7d49fba2b63', 'request_id': 'req-877c5b80-6443-4174-acf5-ac1494580c8c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.159241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] The token cache is being invalidate because project fedea74313814865b1f4a7d49fba2b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:04.159527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.160162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.161753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1201/2430] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:04 2021] DELETE /identity/v3/projects/fedea74313814865b1f4a7d49fba2b63 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:04.165909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:04.175616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c00c-5138-4297-8b51-8afa90521920 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:04.230664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:04.231601 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:04.231865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:04.232141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] PATH_INFO: `/v3/users/ec64eaf24f8f4a7fbe3230b04bc4b8fe` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:04.233392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec64eaf24f8f4a7fbe3230b04bc4b8fe)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:04.235345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:04.286288 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec64eaf24f8f4a7fbe3230b04bc4b8fe'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.293142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec64eaf24f8f4a7fbe3230b04bc4b8fe'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.304216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec64eaf24f8f4a7fbe3230b04bc4b8fe'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.311605 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec64eaf24f8f4a7fbe3230b04bc4b8fe'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.311952 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec64eaf24f8f4a7fbe3230b04bc4b8fe'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.317665 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1230/2431] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:04 2021] DELETE /identity/v3/users/ec64eaf24f8f4a7fbe3230b04bc4b8fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:04.574240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:04.575817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:04.589338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5b80-6443-4174-acf5-ac1494580c8c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:04.644745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:04.645641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:04.645924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:04.646200 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] PATH_INFO: `/v3/projects/6b52ba5876f14011bb4b4be8714b00a6` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:04.647418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b52ba5876f14011bb4b4be8714b00a6)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:04.649357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:04.695349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b52ba5876f14011bb4b4be8714b00a6', 'request_id': 'req-26fc5106-08ab-46cc-8542-a93766bbc57e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.702237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b52ba5876f14011bb4b4be8714b00a6', 'request_id': 'req-26fc5106-08ab-46cc-8542-a93766bbc57e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.707520 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b52ba5876f14011bb4b4be8714b00a6', 'request_id': 'req-26fc5106-08ab-46cc-8542-a93766bbc57e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.720727 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] The token cache is being invalidate because project 6b52ba5876f14011bb4b4be8714b00a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:04.721093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.721715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.723239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1202/2432] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:04 2021] DELETE /identity/v3/projects/6b52ba5876f14011bb4b4be8714b00a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:04.727234 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:04.728656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:04.741158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80755-bba0-4b85-9d5e-243cf5116515 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:04.794646 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:04.795440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:04.795720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:04.795998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] PATH_INFO: `/v3/users/23cf8368a73340ecb57aaedb19393856` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:04.797231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cf8368a73340ecb57aaedb19393856)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:04.799156 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:04.843128 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cf8368a73340ecb57aaedb19393856'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.850117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cf8368a73340ecb57aaedb19393856'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.861318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cf8368a73340ecb57aaedb19393856'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.867848 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cf8368a73340ecb57aaedb19393856'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.868484 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-c0ffe11b-82d4-4ebf-b679-a92042802aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cf8368a73340ecb57aaedb19393856'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:04.874312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1231/2433] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:04 2021] DELETE /identity/v3/users/23cf8368a73340ecb57aaedb19393856 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:05.134983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.136394 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:05.150855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5106-08ab-46cc-8542-a93766bbc57e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.213432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.214400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.214734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.215185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] PATH_INFO: `/v3/projects/a94eaef359104dd1ac75356d2a9a8331` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.216470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94eaef359104dd1ac75356d2a9a8331)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.218985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.263165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94eaef359104dd1ac75356d2a9a8331', 'request_id': 'req-5255b8cf-7e37-45b1-87ca-ad753a107080'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:05.269735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94eaef359104dd1ac75356d2a9a8331', 'request_id': 'req-5255b8cf-7e37-45b1-87ca-ad753a107080'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:05.274999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94eaef359104dd1ac75356d2a9a8331', 'request_id': 'req-5255b8cf-7e37-45b1-87ca-ad753a107080'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:05.287613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] The token cache is being invalidate because project a94eaef359104dd1ac75356d2a9a8331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:05.287970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:05.288601 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5255b8cf-7e37-45b1-87ca-ad753a107080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:05.290144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1203/2434] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:05 2021] DELETE /identity/v3/projects/a94eaef359104dd1ac75356d2a9a8331 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:05.297774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.298069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.298346 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.316056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:05.317297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:05.382216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1232/2435] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:05.391791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.392089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.392371 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.413613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:05.414832 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:05.422850 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1204/2436] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:05.427467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.437148 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975a6b-2706-4ed7-8538-f08a68b44011 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.441749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.442394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.442677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.442956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.443719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:05.444028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.445659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.457262 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1233/2437] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:05.461576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.471296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792455f7-4967-4ad8-833e-3678f9a3eab7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.476019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.476662 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.477099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.477399 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.478142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.480129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.507432 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1205/2438] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:05.511188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.521736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0a86-8f94-459f-9256-cd197b11beec admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.577326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.577898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.578198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.578456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.579190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.581168 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.601816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1234/2439] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:05.605986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.616306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc1942-68ff-4674-9426-61e007a70e6d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.621088 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.621739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.622003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.622279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.623015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.624645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.635177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1206/2440] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:05.639873 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.649767 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a143a-cb7e-4c80-a173-cfd7337ca80f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.654420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.655672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.655953 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.656226 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.656986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.658581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c9f7-3af9-47c9-952e-30f6f7e6cfbe admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.668153 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1235/2441] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:05.672462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.682564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef23c-39ca-4cd1-adff-992e4bc4c5a8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.687181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.688041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.688318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.688588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] PATH_INFO: `/v3/projects/117b24e8e4764ac3ac48a865b5555f30/users/34d47c5fc16846ce9f0985ce3da9d171/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.702970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117b24e8e4764ac3ac48a865b5555f30, user_id=34d47c5fc16846ce9f0985ce3da9d171, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.705631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.720006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1207/2442] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:05 2021] PUT /identity/v3/projects/117b24e8e4764ac3ac48a865b5555f30/users/34d47c5fc16846ce9f0985ce3da9d171/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:05.731278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.731782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.731877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.759385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] MFA Rules not processed for user `34d47c5fc16846ce9f0985ce3da9d171`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:05.760495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:05.820394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1236/2443] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:05.824963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.884046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c38a-780d-46c6-83e2-79282459b108 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.888715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.890018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.890297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.890569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.891271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.893226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:05.916999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1208/2444] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:05.921194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:05.931867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647b1a4-e90f-4841-bcd9-d95c4f4b2d14 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:05.984864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:05.985549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:05.985904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:05.986108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:05.986805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:05.988721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.008531 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1237/2445] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:05 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:06.012604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.023776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7845f-ecc8-4787-bed4-cedbdb326ae1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.028478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.029157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.029440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.029775 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.030503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.032080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.042538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1209/2446] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:06.046629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.056473 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec676771-ca1f-4f9f-a956-d6a3c411da0d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.061590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.062480 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.062758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.063028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] PATH_INFO: `/v3/projects/0e53627096b84074b2678ce8e0a61552/users/62af3cc7fd9643ecb7d3bbf83bcebc04/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.077247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e53627096b84074b2678ce8e0a61552, user_id=62af3cc7fd9643ecb7d3bbf83bcebc04, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.079877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.092181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1238/2447] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:06 2021] PUT /identity/v3/projects/0e53627096b84074b2678ce8e0a61552/users/62af3cc7fd9643ecb7d3bbf83bcebc04/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:06.096074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.105937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb9ed-7bdb-4b39-b1c4-d4e354bcbed3 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.163503 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.164109 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.164377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.164651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.165433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.167019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dd8f2-ac99-4692-bcfd-52c331c9b1c6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.176813 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1210/2448] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:06 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:06.180895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.191067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aa2d-6801-4617-9f4d-adf165d80770 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.195758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.196626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.196905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.197216 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] PATH_INFO: `/v3/projects/0e53627096b84074b2678ce8e0a61552/users/62af3cc7fd9643ecb7d3bbf83bcebc04/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.199186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e53627096b84074b2678ce8e0a61552, user_id=62af3cc7fd9643ecb7d3bbf83bcebc04, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.202368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.212747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1239/2449] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:06 2021] PUT /identity/v3/projects/0e53627096b84074b2678ce8e0a61552/users/62af3cc7fd9643ecb7d3bbf83bcebc04/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:06.224210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.224492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.224857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.251978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] MFA Rules not processed for user `62af3cc7fd9643ecb7d3bbf83bcebc04`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:06.253413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:06.325836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1211/2450] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:06 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:06.336917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.339006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:06.398138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962be3-db8f-4039-bb02-fbd4ce3a1c31 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.401958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.406254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.406254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.406254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.412627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.414188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3834f7-9874-41fe-9fcf-347b54eb0cf0 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.425617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1240/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:06 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:06.772581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:06.839485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2970-aadf-453f-8caa-ab31f6833f07 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:06.844241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:06.845201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.845480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.845816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] PATH_INFO: `/v3/users/34d47c5fc16846ce9f0985ce3da9d171` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.847013 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d47c5fc16846ce9f0985ce3da9d171)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:06.848919 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:06.894808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d47c5fc16846ce9f0985ce3da9d171'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:06.905969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d47c5fc16846ce9f0985ce3da9d171'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:06.912345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d47c5fc16846ce9f0985ce3da9d171'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:06.913097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d47c5fc16846ce9f0985ce3da9d171'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:06.913737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d47c5fc16846ce9f0985ce3da9d171'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:06.927145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1212/2452] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:06 2021] DELETE /identity/v3/users/34d47c5fc16846ce9f0985ce3da9d171 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:06.931749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:06.932228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:06.932340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:06.950612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:06.951834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:07.007610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1241/2453] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:07.017549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:07.018928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:07.074322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542c0d-b138-4f8c-ade5-0aa473c2a85f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:07.078537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:07.079164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:07.079448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:07.079722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:07.088794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:07.090251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:07.100462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1213/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:07.360454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:07.361921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:07.376788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb5e5b-1c4d-4fff-85ed-6b37affe3792 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:07.382177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:07.383392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:07.383673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:07.384221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] PATH_INFO: `/v3/projects/117b24e8e4764ac3ac48a865b5555f30` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:07.385613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=117b24e8e4764ac3ac48a865b5555f30)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:07.387539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:07.445324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117b24e8e4764ac3ac48a865b5555f30', 'request_id': 'req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.454171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117b24e8e4764ac3ac48a865b5555f30', 'request_id': 'req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.460101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117b24e8e4764ac3ac48a865b5555f30', 'request_id': 'req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.470314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] The token cache is being invalidate because project 117b24e8e4764ac3ac48a865b5555f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:07.470801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.471474 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.473059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1242/2455] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:07 2021] DELETE /identity/v3/projects/117b24e8e4764ac3ac48a865b5555f30 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:07.477069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:07.487012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae441-b3e6-47cf-b519-4254edf7dd52 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:07.490046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:07.491424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:07.542299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:07.543167 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:07.543451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:07.543729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] PATH_INFO: `/v3/users/62af3cc7fd9643ecb7d3bbf83bcebc04` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:07.544931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62af3cc7fd9643ecb7d3bbf83bcebc04)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:07.547438 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:07.548198 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee1d3-9406-4a1d-9c26-33ea99bfc58a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:07.552138 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:07.552856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:07.553193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:07.553468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:07.555271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:07.566928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:07.568339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:07.578641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1243/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:07.592179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62af3cc7fd9643ecb7d3bbf83bcebc04'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.604416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62af3cc7fd9643ecb7d3bbf83bcebc04'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.611019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62af3cc7fd9643ecb7d3bbf83bcebc04'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.611737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62af3cc7fd9643ecb7d3bbf83bcebc04'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.612347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0af8c0e2-e87e-4a0d-967f-86616fbe5d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62af3cc7fd9643ecb7d3bbf83bcebc04'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:07.627050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1214/2457] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:07 2021] DELETE /identity/v3/users/62af3cc7fd9643ecb7d3bbf83bcebc04 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:08.413815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.415309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:08.428051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132f05-f091-47c7-a4b4-100b4405be2c service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.492860 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.493749 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.494030 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.494303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] PATH_INFO: `/v3/projects/0e53627096b84074b2678ce8e0a61552` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.495510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e53627096b84074b2678ce8e0a61552)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.497468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.543993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e53627096b84074b2678ce8e0a61552', 'request_id': 'req-5f998080-889b-4900-b34d-1138734dc1ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:08.551542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e53627096b84074b2678ce8e0a61552', 'request_id': 'req-5f998080-889b-4900-b34d-1138734dc1ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:08.557712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e53627096b84074b2678ce8e0a61552', 'request_id': 'req-5f998080-889b-4900-b34d-1138734dc1ac'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:08.567613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] The token cache is being invalidate because project 0e53627096b84074b2678ce8e0a61552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:08.567905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:08.568555 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5f998080-889b-4900-b34d-1138734dc1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:08.570114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1244/2458] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:08 2021] DELETE /identity/v3/projects/0e53627096b84074b2678ce8e0a61552 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:08.575946 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.577321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.577321 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.595121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:08.596416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:08.655724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1215/2459] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:08.663943 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.664315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.664654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.683159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:08.684453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:08.693285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1245/2460] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:08.697526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.707171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87b605-2109-4f42-852b-ed7598a63f21 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.712522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.713269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.713521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.713852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.715760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:08.715760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.716706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.732339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1216/2461] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:08.734232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.743347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f3cc-4208-4a16-81e1-601f817c396f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.748045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.748697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.748999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.749277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.749971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.752160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.778113 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1246/2462] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:08 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:08.782770 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.792654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72840-30b7-4cab-9296-6f31dfde4982 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.849205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.849994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.850419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.850901 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.851782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.854262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.879499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1217/2463] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:08 2021] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:08.881119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.891282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758c059-2180-47e1-a0b9-e48c99ebf5c9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.895931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.896584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.896865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.897171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.897901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.899492 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.912161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1247/2464] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:08.916248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.927008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8810850-d09c-4703-9c94-6f8e88028eb5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.931857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.932519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.932960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.933254 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.934014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.935621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a0fd-3512-4312-8258-7ce1f0bfa141 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:08.951987 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1218/2465] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:08.953208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:08.964208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8480547-686d-4d8c-a99c-573ca7bfd467 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:08.969588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:08.970625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:08.970916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:08.971196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] PATH_INFO: `/v3/projects/e80ecbd17d474e3b94d36f71f4e8fcf1/users/d533f8694f6e46baa643426b30e55835/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:08.988202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80ecbd17d474e3b94d36f71f4e8fcf1, user_id=d533f8694f6e46baa643426b30e55835, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:08.991072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:09.009219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1248/2466] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:08 2021] PUT /identity/v3/projects/e80ecbd17d474e3b94d36f71f4e8fcf1/users/d533f8694f6e46baa643426b30e55835/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:09.018341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:09.018631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:09.018909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:09.051941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] MFA Rules not processed for user `d533f8694f6e46baa643426b30e55835`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:09.053272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:09.127229 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1219/2467] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:09.137431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:09.139182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:09.193378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cebfa7-2076-461a-94cc-d66241f62819 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:09.197083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:09.197739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:09.198015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:09.198296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:09.207150 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:09.208532 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212a6b-ef06-4812-8126-bf6d073e2e74 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:09.217501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1249/2468] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:09 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:09.237197 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:09.302097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb0b66-89fa-4b26-929e-48b0a26df6cd None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:09.306867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:09.307746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:09.308029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:09.308299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] PATH_INFO: `/v3/users/d533f8694f6e46baa643426b30e55835` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:09.309640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d533f8694f6e46baa643426b30e55835)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:09.312290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:09.357607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd533f8694f6e46baa643426b30e55835'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:09.369224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd533f8694f6e46baa643426b30e55835'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:09.376865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd533f8694f6e46baa643426b30e55835'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:09.377608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd533f8694f6e46baa643426b30e55835'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:09.378225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd533f8694f6e46baa643426b30e55835'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:09.393726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1220/2469] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:09 2021] DELETE /identity/v3/users/d533f8694f6e46baa643426b30e55835 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:09.398576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:09.398865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:09.399146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:09.417114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:09.418334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:09.484914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1250/2470] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:09.494966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:09.496470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:09.574905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3d0d-729b-4bd7-9bd1-2901d439b3c0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:09.582462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:09.583132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:09.583540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:09.583874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:09.596288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:09.597783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:09.609170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1221/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:09.994979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:09.996707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:10.013411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917325c9-fad3-4ca7-903d-1efe5d6b850f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:10.018998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:10.020020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:10.020308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:10.020587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] PATH_INFO: `/v3/projects/e80ecbd17d474e3b94d36f71f4e8fcf1` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:10.021859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80ecbd17d474e3b94d36f71f4e8fcf1)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:10.023786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:10.072502 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80ecbd17d474e3b94d36f71f4e8fcf1', 'request_id': 'req-5c7fcbb3-58fa-402a-8fad-befb324e0843'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:10.080649 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80ecbd17d474e3b94d36f71f4e8fcf1', 'request_id': 'req-5c7fcbb3-58fa-402a-8fad-befb324e0843'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:10.086811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80ecbd17d474e3b94d36f71f4e8fcf1', 'request_id': 'req-5c7fcbb3-58fa-402a-8fad-befb324e0843'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:10.097894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] The token cache is being invalidate because project e80ecbd17d474e3b94d36f71f4e8fcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:10.098324 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:10.099066 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:10.100708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1251/2472] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:09 2021] DELETE /identity/v3/projects/e80ecbd17d474e3b94d36f71f4e8fcf1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:11.227734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:11.229387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:11.249213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2bb-af85-402c-9c7d-2f63bbf9d071 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:11.305749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:11.306630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.306921 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.307195 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] PATH_INFO: `/v3/users/d86e0624da9446b9a7bbffc277f18ce9` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.308417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86e0624da9446b9a7bbffc277f18ce9)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:11.310501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:11.355907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86e0624da9446b9a7bbffc277f18ce9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.367557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86e0624da9446b9a7bbffc277f18ce9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.374838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86e0624da9446b9a7bbffc277f18ce9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.375781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86e0624da9446b9a7bbffc277f18ce9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.376402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-2a242f2c-5daa-40fb-b703-4544dbffd54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86e0624da9446b9a7bbffc277f18ce9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.388272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1222/2473] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:11 2021] DELETE /identity/v3/users/d86e0624da9446b9a7bbffc277f18ce9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:11.559730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:11.562106 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:11.575540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fcbb3-58fa-402a-8fad-befb324e0843 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:11.630236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:11.631083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.631359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.631628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] PATH_INFO: `/v3/projects/3531038be7ef42149fa8f272160c7686` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.632933 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3531038be7ef42149fa8f272160c7686)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:11.634990 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:11.679672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3531038be7ef42149fa8f272160c7686', 'request_id': 'req-336345ef-dfa0-4ae5-8f4f-08ae5af32661'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.687366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3531038be7ef42149fa8f272160c7686', 'request_id': 'req-336345ef-dfa0-4ae5-8f4f-08ae5af32661'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.693479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3531038be7ef42149fa8f272160c7686', 'request_id': 'req-336345ef-dfa0-4ae5-8f4f-08ae5af32661'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.702973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] The token cache is being invalidate because project 3531038be7ef42149fa8f272160c7686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:11.703256 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.703876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-336345ef-dfa0-4ae5-8f4f-08ae5af32661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:11.705440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1252/2474] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:11 2021] DELETE /identity/v3/projects/3531038be7ef42149fa8f272160c7686 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:11.711304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.711600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.711903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.730123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:11.731303 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:11.786641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1223/2475] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:11.794587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.794863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.795192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.814176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:11.815903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:11.825487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1253/2476] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:11.830340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:11.839747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af92b6e-1cb7-48ab-b108-ace54ffad505 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:11.844359 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:11.845026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.845306 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.845576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.846297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:11.846599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:11.848173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:11.859236 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1224/2477] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:11.863530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:11.872557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985eb4-f800-45c9-9aff-b6e47ca83d81 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:11.877976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:11.878612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.878893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.879166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.879855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:11.881770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:11.906693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1254/2478] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:11 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:11.910691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:11.920383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4b24a-2c7c-4d84-8deb-c169bd86208e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:11.975970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:11.976631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:11.976912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:11.977223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:11.977903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:11.979781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:11.999244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1225/2479] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:11 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:12.003438 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:12.013528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742e91-9b58-4af2-8a72-982d1f43dfff admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:12.018976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:12.019625 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:12.019905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:12.020178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:12.020977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:12.022576 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:12.033223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1255/2480] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:12.037510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:12.047129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7d977-e749-482c-813d-3d108f60a7cc admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:12.051731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:12.052384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:12.052663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:12.052935 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:12.053684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:12.055251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665d9c1-74a0-481a-8ec1-5c4d295ad14f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:12.065765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1226/2481] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:12.069782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:12.081012 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fae1fa-c737-4d12-b72c-4f68891b0fe6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:12.085731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:12.086635 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:12.086915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:12.087213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] PATH_INFO: `/v3/projects/64768c7c6b3e472ba31012aec930294b/users/a3d7a66a932e46de970ee80cd77f5f87/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:12.101381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64768c7c6b3e472ba31012aec930294b, user_id=a3d7a66a932e46de970ee80cd77f5f87, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:12.104029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:12.117320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1256/2482] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:12 2021] PUT /identity/v3/projects/64768c7c6b3e472ba31012aec930294b/users/a3d7a66a932e46de970ee80cd77f5f87/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:12.128981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:12.128981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:12.128981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:12.155240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] MFA Rules not processed for user `a3d7a66a932e46de970ee80cd77f5f87`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:12.156461 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:12.218712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1227/2483] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:12.230192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:12.231901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:12.302742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f300-c748-44fc-9ab9-acd36c8a21e5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:12.308245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:12.308894 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:12.309208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:12.309485 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:12.318077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:12.320003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad938db-5409-4392-a7bc-c44b47df838b service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:12.329898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1257/2484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:12 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:20.577731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:20.636841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa43c4-d612-4177-b49e-ce15ed92c766 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:20.641972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:20.642830 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:20.643114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:20.643388 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] PATH_INFO: `/v3/users/a3d7a66a932e46de970ee80cd77f5f87` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:20.644572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d7a66a932e46de970ee80cd77f5f87)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:20.646522 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:20.689057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d7a66a932e46de970ee80cd77f5f87'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:20.700116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d7a66a932e46de970ee80cd77f5f87'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:20.707076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d7a66a932e46de970ee80cd77f5f87'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:20.707736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d7a66a932e46de970ee80cd77f5f87'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:20.708343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d7a66a932e46de970ee80cd77f5f87'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:20.721595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1228/2485] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:20 2021] DELETE /identity/v3/users/a3d7a66a932e46de970ee80cd77f5f87 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:20.726268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:20.726759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:20.726866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:20.743844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:20.745073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:20.801388 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1258/2486] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:20.812186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:20.813814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:20.871410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871da34-196c-4753-bb75-717faea52da6 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:20.875092 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:20.875990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:20.876272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:20.876548 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:20.885581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:20.887008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa30f-6cea-4f5d-ab72-1401c90b37fa service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:20.896294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1229/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:21.148798 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.150629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:21.163538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73bd6-3e22-4a5c-8f43-bf33d37656c3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.168181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.169219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.169507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.169816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] PATH_INFO: `/v3/projects/64768c7c6b3e472ba31012aec930294b` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.171303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64768c7c6b3e472ba31012aec930294b)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.173787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.221022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64768c7c6b3e472ba31012aec930294b', 'request_id': 'req-7be9f97b-d2c9-4f0b-b792-4063954d935e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:21.227927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64768c7c6b3e472ba31012aec930294b', 'request_id': 'req-7be9f97b-d2c9-4f0b-b792-4063954d935e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:21.233945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64768c7c6b3e472ba31012aec930294b', 'request_id': 'req-7be9f97b-d2c9-4f0b-b792-4063954d935e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:21.243931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] The token cache is being invalidate because project 64768c7c6b3e472ba31012aec930294b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:21.244215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:21.244835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7be9f97b-d2c9-4f0b-b792-4063954d935e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:21.246400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1259/2488] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:21 2021] DELETE /identity/v3/projects/64768c7c6b3e472ba31012aec930294b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:21.252395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.252670 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.252963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.270631 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:21.271810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:21.329523 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1230/2489] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:21.338437 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.338721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.339000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.357541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:21.358737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:21.366534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1260/2490] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:21.370630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.380205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4371d1-20ba-4439-9719-e79c56ee6f1e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.384767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.385445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.385729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.386002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.386726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:21.387033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.388645 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.400440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1231/2491] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:21.405383 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.414750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1004eb-79c5-4c18-8a50-fabae6751f25 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.419433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.420098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.420374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.420642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.421374 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.423287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.447919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1261/2492] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:21 2021] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:21.452644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.462604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216622-0b12-472a-9564-3cbce473dbce admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.517089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.517738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.518020 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.518297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.519000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.520897 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.540168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1232/2493] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:21 2021] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:21.544562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.555333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162932f-f900-4e7f-b939-c88f965da89c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.560013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.561197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.561467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.561761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.562487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.564065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.574441 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1262/2494] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:21.579101 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.589208 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e4e4-ca15-4518-8e90-4758bea76870 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.594060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.594707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.594983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.595250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.595976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.597589 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda25e6-6495-4d5d-85f6-680b73d048a9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.607296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1233/2495] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:21.611333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.620903 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835ce2d-d775-474a-b2fd-ea8d0f71379f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.626258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.627111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.627387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.627658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] PATH_INFO: `/v3/projects/9bd171776def4dec8aacdae2badb6069/users/38f10b51ce5343719cc011d1e307f3ce/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.641959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd171776def4dec8aacdae2badb6069, user_id=38f10b51ce5343719cc011d1e307f3ce, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.644603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.657654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1263/2496] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:21 2021] PUT /identity/v3/projects/9bd171776def4dec8aacdae2badb6069/users/38f10b51ce5343719cc011d1e307f3ce/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:21.667717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.668009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.668285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.694295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] MFA Rules not processed for user `38f10b51ce5343719cc011d1e307f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:21.695490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:21.757608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1234/2497] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:21 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:21.768212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:21.769883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:21.827359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139be4b-d619-436e-a93d-f2615136db02 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:21.831015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:21.831653 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:21.831925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:21.832196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:21.840397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:21.841855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58967fb-c795-43b7-945c-867cae9b599b service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:21.850587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1264/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:21 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:30.054534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:30.116873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde02d-330b-4e4b-8853-d79c1ffbf0b7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:30.121539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:30.122466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:30.122741 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:30.123012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] PATH_INFO: `/v3/users/38f10b51ce5343719cc011d1e307f3ce` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:30.124849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f10b51ce5343719cc011d1e307f3ce)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:30.127064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:30.176405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f10b51ce5343719cc011d1e307f3ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:30.189665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f10b51ce5343719cc011d1e307f3ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:30.196625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f10b51ce5343719cc011d1e307f3ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:30.197389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f10b51ce5343719cc011d1e307f3ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:30.197991 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f10b51ce5343719cc011d1e307f3ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:30.216445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1235/2499] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:30 2021] DELETE /identity/v3/users/38f10b51ce5343719cc011d1e307f3ce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:30.221350 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:30.222232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:30.222663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:30.241959 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:30.243527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:30.305082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1265/2500] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:30.321145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:30.323633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:30.400131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378de6-49b7-4c33-bdd3-2f0150bc8cf0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:30.404065 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:30.404742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:30.405064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:30.405528 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:30.416168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:30.417789 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8230c5b-fd94-4a2f-8bbf-66ebb3070f71 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:30.428894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1236/2501] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:30.920684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:30.922353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:30.936201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aefbb-1855-4017-a0d5-2a27ffcb98a3 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:30.942841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:30.944238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:30.944911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:30.945810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] PATH_INFO: `/v3/projects/9bd171776def4dec8aacdae2badb6069` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:30.947783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd171776def4dec8aacdae2badb6069)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:30.950223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.002567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd171776def4dec8aacdae2badb6069', 'request_id': 'req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:31.009924 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd171776def4dec8aacdae2badb6069', 'request_id': 'req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:31.016999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd171776def4dec8aacdae2badb6069', 'request_id': 'req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:31.027096 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] The token cache is being invalidate because project 9bd171776def4dec8aacdae2badb6069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:31.027387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:31.028047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-b0729891-5cda-45b9-a1fc-ac54ad7f4ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:31.029668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1266/2502] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:30 2021] DELETE /identity/v3/projects/9bd171776def4dec8aacdae2badb6069 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:31.036046 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.036338 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.036614 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.053930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:31.055327 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:31.113514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1237/2503] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:31.121481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.121770 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.122039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.140657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:31.141994 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:31.153598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1267/2504] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:31.154718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.166158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14529e90-8ef3-4f70-8289-c2ca40fd72db None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.172318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.173384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.173947 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.174387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.175396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:31.176582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.178393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.192190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1238/2505] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:00:31.196269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.205677 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2495-1adb-4591-9119-24045fa0337f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.211000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873714-7868-4755-975b-1721899b416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.211656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873714-7868-4755-975b-1721899b416a admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.211951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873714-7868-4755-975b-1721899b416a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.212214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873714-7868-4755-975b-1721899b416a admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.212929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873714-7868-4755-975b-1721899b416a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.215298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873714-7868-4755-975b-1721899b416a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.247699 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1268/2506] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:31.252379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.263542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a343818-26c1-477a-97a1-2d76547845aa admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.337572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.338251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.338530 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.338803 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.339505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.341478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.362634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1239/2507] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/users => generated 278 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:31.366772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873714-7868-4755-975b-1721899b416a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.378015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873714-7868-4755-975b-1721899b416a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.382766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.383429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.383711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.383985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.384718 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.386364 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.399520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1269/2508] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:31.400700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.411534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ea31-ebb5-42b9-b8bf-1c4609669f25 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.416492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.417194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.417510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.417783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.418532 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.420116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0561cd-0ba7-4fcc-9448-a0d139607b86 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.431034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1240/2509] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:31.435511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.446776 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9772-5029-471b-b27b-fcec6bc9b142 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.451716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.452693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.452909 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.453259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] PATH_INFO: `/v3/projects/3bed4e3ad9e84776a8a0670afbdc5aff/users/ba8d1987589340c89df1916cdbc244fd/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.467729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bed4e3ad9e84776a8a0670afbdc5aff, user_id=ba8d1987589340c89df1916cdbc244fd, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.471174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.485457 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1270/2510] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:31 2021] PUT /identity/v3/projects/3bed4e3ad9e84776a8a0670afbdc5aff/users/ba8d1987589340c89df1916cdbc244fd/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:31.496612 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.496898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.497210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.523705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] MFA Rules not processed for user `ba8d1987589340c89df1916cdbc244fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:31.524926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:31.595360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1241/2511] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:31.599948 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.661669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d074152-c9f7-4496-af4e-37a12c2da758 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.666799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.667462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.667750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.668032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.668747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.670782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.700342 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1271/2512] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:31.701486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.713943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa114f3-cd68-4f6e-bafe-510bdaf244bc None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.772509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.773232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.773491 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.773768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.774481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.776408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.802446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1242/2513] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:31 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:31.806309 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.818010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2144e-9141-4d25-9b5a-967ca2647c1a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.823240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.826786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.826786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.826786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.826786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.828430 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.840314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1272/2514] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:31.845094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.859239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a476c-e230-4239-a4b7-c172a39d3233 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.864515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.865497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.865767 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.866041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] PATH_INFO: `/v3/projects/6fe758ccb03349928a14e35f042079a1/users/971d29894c1342ef8aebe58be02f10b8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.883313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe758ccb03349928a14e35f042079a1, user_id=971d29894c1342ef8aebe58be02f10b8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.886014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.903403 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1243/2515] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:31 2021] PUT /identity/v3/projects/6fe758ccb03349928a14e35f042079a1/users/971d29894c1342ef8aebe58be02f10b8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:31.906720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:31.917580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69878f6-8724-43fd-8809-9362d0791088 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:31.979169 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:31.979829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:31.980104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:31.980373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:31.981136 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:31.982743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502afdd1-8f0f-4174-93a1-c1430fd5d2a1 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:31.992999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1273/2516] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:31.997107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:32.010169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa6367-644d-4309-96c9-e77834a40df4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:32.015715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:32.016607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:32.016887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:32.017263 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] PATH_INFO: `/v3/projects/6fe758ccb03349928a14e35f042079a1/users/971d29894c1342ef8aebe58be02f10b8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:32.019315 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe758ccb03349928a14e35f042079a1, user_id=971d29894c1342ef8aebe58be02f10b8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:32.022007 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:32.035343 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1244/2517] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:31 2021] PUT /identity/v3/projects/6fe758ccb03349928a14e35f042079a1/users/971d29894c1342ef8aebe58be02f10b8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:32.046167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:32.046515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:32.046845 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:32.074447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] MFA Rules not processed for user `971d29894c1342ef8aebe58be02f10b8`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:32.075656 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:32.142147 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1274/2518] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:32 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:32.153044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:32.154859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:32.211032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a35a-d426-47e4-8183-54a5cd71730a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:32.215050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:32.215776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:32.216124 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:32.216470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:32.225873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:32.227340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:32.236982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1245/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:32 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:32.311188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:32.321869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590645c3-a2e0-43d0-b18d-cb641a28cf6c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:32.325634 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:32.326275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:32.326558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:32.326833 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:32.383646 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:32.385254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:32.395011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1275/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:32 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:34.915084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:34.916629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:34.975442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242729-a241-4060-b684-d2e7ea81aea8 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:34.979159 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:34.979918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:34.980294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:34.980572 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:34.982576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:35.052160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:35.053629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:35.065486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1246/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:38.385365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:38.386841 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:38.402177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166cd7-9ac2-4ca5-a4cf-534c4f7af91e service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:38.407327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:38.408233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.408518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.408787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] PATH_INFO: `/v3/users/71c73055c359426aa992230971e72a0e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.410116 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c73055c359426aa992230971e72a0e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:38.412059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:38.457520 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c73055c359426aa992230971e72a0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.464701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c73055c359426aa992230971e72a0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.476400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c73055c359426aa992230971e72a0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.483142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c73055c359426aa992230971e72a0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.484353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-99620f46-305b-4429-92a1-4108c409e572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c73055c359426aa992230971e72a0e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.490114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1276/2522] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:38 2021] DELETE /identity/v3/users/71c73055c359426aa992230971e72a0e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:38.655626 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:38.673361 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97551ea-ce24-4f0a-9a12-632fe145d944 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:38.731178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:38.732099 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.732381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.732660 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] PATH_INFO: `/v3/projects/d8fb7a8c01df44dfb4966cb60dcbe595` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.734453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fb7a8c01df44dfb4966cb60dcbe595)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:38.736336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:38.779766 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fb7a8c01df44dfb4966cb60dcbe595', 'request_id': 'req-09b16850-fb80-4a33-9708-575b858d9554'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.786732 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fb7a8c01df44dfb4966cb60dcbe595', 'request_id': 'req-09b16850-fb80-4a33-9708-575b858d9554'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.792319 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fb7a8c01df44dfb4966cb60dcbe595', 'request_id': 'req-09b16850-fb80-4a33-9708-575b858d9554'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.808246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] The token cache is being invalidate because project d8fb7a8c01df44dfb4966cb60dcbe595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:38.808246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.808246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-09b16850-fb80-4a33-9708-575b858d9554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:38.808246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1247/2523] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:38 2021] DELETE /identity/v3/projects/d8fb7a8c01df44dfb4966cb60dcbe595 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:38.813762 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.814047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.814352 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.831983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:38.833369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:38.891886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1277/2524] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:38.900218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.900218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.900510 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.919209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:38.920418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:38.930565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1248/2525] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:38.935005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:38.945016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608d546-ceb5-4aac-a8af-bb6d222abedd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:38.949830 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:38.950526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.950819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.951125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.952104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:38.952417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:38.954080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:38.972514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1278/2526] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:38.973553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:38.983060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4962a-309e-43a3-844c-6680ba3eb8a0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:38.988482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:38.989187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.989468 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.989866 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.990579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:38.992540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.018480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1249/2527] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:38 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:39.023014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.033669 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56090fb-e89d-412e-a62b-7d81770c3c00 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.094092 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.094754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.095032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.095398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.095986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.097923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.118276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1279/2528] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:39 2021] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:39.122833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.134054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a6e9-ab7f-4886-98c4-78b68fc11337 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.140540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.141395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.141814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.142220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.143137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.145083 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.158927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1250/2529] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:39.165044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.180507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776c8a-d2ae-4019-81ef-aadbd12b3640 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.188713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.189955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.190260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.190719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.191906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.194753 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.217642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1280/2530] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:39.219198 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.229475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd33e-acfc-4cd8-b592-d7d2839d603c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.234241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.235056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.235331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.235600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] PATH_INFO: `/v3/projects/d8a1645a6903482684dd541da05d36e7/users/79845630a58c458d982245698544f766/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.250616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a1645a6903482684dd541da05d36e7, user_id=79845630a58c458d982245698544f766, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.253465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a40d8-bfd4-4543-b0f9-ce0389ad35af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.266599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1251/2531] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:39 2021] PUT /identity/v3/projects/d8a1645a6903482684dd541da05d36e7/users/79845630a58c458d982245698544f766/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:39.276929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.277423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.277782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.278154 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.278682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.304308 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] MFA Rules not processed for user `79845630a58c458d982245698544f766`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:39.306675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.334949 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d584b4-0e44-40f1-ad7d-b918d6c0919e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.369763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1252/2532] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:39 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:39.374168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.382022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.382670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.382951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.383229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.385065 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.437245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736732d6-1e3b-4396-ae8e-74e0b21dcdb4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.442064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.442738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.443018 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.443288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.444012 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.445966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.446528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.447970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.457650 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1281/2533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:39.473667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1253/2534] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:39 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:39.477463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.488272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badbb45-d53e-4f58-93f5-da7c9c71117f service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.542020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.542692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.542968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.543239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.543942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.545940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.568865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1282/2535] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:39 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:39.570406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.581283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0332c-22f4-4b94-8f9a-3eeefe8fd21e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.586095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.586758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.587037 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.587310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.588044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.589679 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.601389 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1254/2536] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:39.606069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.615925 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da46c9-4a43-4e69-9c79-d57f578b7f64 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.620721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.621636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.621935 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.622190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] PATH_INFO: `/v3/projects/4d19c43f0b67436080750543663f59a5/users/fb741d35136642cfaa659983e1bf0ddc/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.637582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d19c43f0b67436080750543663f59a5, user_id=fb741d35136642cfaa659983e1bf0ddc, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.640984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.654773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1283/2537] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:39 2021] PUT /identity/v3/projects/4d19c43f0b67436080750543663f59a5/users/fb741d35136642cfaa659983e1bf0ddc/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:39.658759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.669799 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc945ea-24e1-4d30-82a4-aeb7a6df074d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.726381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.727060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.727344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.727621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.728354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.730056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130dde8-63a3-4bdf-b76d-c77b2240ce4c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.743270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1255/2538] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:39.744711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.755639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7bb5f-1fca-400e-acf8-191d00bbee3c admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.760491 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.761401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.761816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.762099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] PATH_INFO: `/v3/projects/4d19c43f0b67436080750543663f59a5/users/fb741d35136642cfaa659983e1bf0ddc/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.764199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d19c43f0b67436080750543663f59a5, user_id=fb741d35136642cfaa659983e1bf0ddc, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.767514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.778266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1284/2539] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:39 2021] PUT /identity/v3/projects/4d19c43f0b67436080750543663f59a5/users/fb741d35136642cfaa659983e1bf0ddc/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:39.788391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.788677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.788974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.815733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] MFA Rules not processed for user `fb741d35136642cfaa659983e1bf0ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:39.816973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.884926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1256/2540] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:39 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:39.895793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.897566 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.954772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efbd75-ca15-4062-83dc-433b6b5ebe6d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.958507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.959151 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.959435 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.959712 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.969129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.970645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.980371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1285/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:40.053976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:40.063915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd09cf1-76e1-4567-9e9d-0cd6d223bb2d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:40.070368 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:40.071456 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:40.071731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:40.072190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:40.128266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:40.129731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67f469-7ea6-41db-b562-4dabe4b02ea8 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:40.138717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1257/2542] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:40 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:47.127440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:47.128877 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:47.193598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b674-69cb-4266-bae5-31ad607c50e8 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:47.198429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:47.199304 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.199581 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.199854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] PATH_INFO: `/v3/users/ba8d1987589340c89df1916cdbc244fd` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.201082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8d1987589340c89df1916cdbc244fd)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:47.203582 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:47.251726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8d1987589340c89df1916cdbc244fd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.259103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8d1987589340c89df1916cdbc244fd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.272751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8d1987589340c89df1916cdbc244fd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.279297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8d1987589340c89df1916cdbc244fd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.280032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8d1987589340c89df1916cdbc244fd'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.285733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1286/2543] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:47 2021] DELETE /identity/v3/users/ba8d1987589340c89df1916cdbc244fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:47.290265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.290812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.290918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.309731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:47.311706 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:47.374729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1258/2544] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:47.382269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:47.383689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:47.441754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d57-8322-4a9f-82ae-7d71e4265281 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:47.447369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:47.447369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.447369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.447369 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.457217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:47.458646 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:47.468958 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1287/2545] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:47.795781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:47.797823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:47.819398 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd473f-82f8-46bd-b4d5-a7c2bef94859 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:47.829288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:47.830351 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.830760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.831103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] PATH_INFO: `/v3/projects/3bed4e3ad9e84776a8a0670afbdc5aff` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.835549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bed4e3ad9e84776a8a0670afbdc5aff)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:47.837300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:47.842802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:47.851011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee69a-5027-48bc-b5fe-ffd8fe882d5e service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:47.854654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:47.855294 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.855655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.855828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.857595 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:47.870313 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:47.871758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:47.881754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1288/2546] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:47.888227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bed4e3ad9e84776a8a0670afbdc5aff', 'request_id': 'req-e2171c20-f4b5-4e80-922e-7d017d38bb27'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.894429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bed4e3ad9e84776a8a0670afbdc5aff', 'request_id': 'req-e2171c20-f4b5-4e80-922e-7d017d38bb27'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.899811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bed4e3ad9e84776a8a0670afbdc5aff', 'request_id': 'req-e2171c20-f4b5-4e80-922e-7d017d38bb27'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.912323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] The token cache is being invalidate because project 3bed4e3ad9e84776a8a0670afbdc5aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:47.912613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.913257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:47.914788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1259/2547] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:47 2021] DELETE /identity/v3/projects/3bed4e3ad9e84776a8a0670afbdc5aff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:47.918682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:47.928807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc414c-bc40-4da1-97c0-a4a22d96bfb4 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:47.981964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:47.982831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:47.983645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:47.983992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] PATH_INFO: `/v3/users/971d29894c1342ef8aebe58be02f10b8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:47.985225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] RBAC: Authorizing `identity:delete_user(user_id=971d29894c1342ef8aebe58be02f10b8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:47.987192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.031821 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971d29894c1342ef8aebe58be02f10b8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.039750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971d29894c1342ef8aebe58be02f10b8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.051862 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971d29894c1342ef8aebe58be02f10b8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.058269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971d29894c1342ef8aebe58be02f10b8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.058974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-6a6acd20-5293-4830-a082-00c6debe74df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971d29894c1342ef8aebe58be02f10b8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.064706 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1289/2548] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:47 2021] DELETE /identity/v3/users/971d29894c1342ef8aebe58be02f10b8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:48.340735 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.342401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:48.357563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171c20-f4b5-4e80-922e-7d017d38bb27 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.417861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.418649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.418930 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.419205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] PATH_INFO: `/v3/projects/6fe758ccb03349928a14e35f042079a1` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.420460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe758ccb03349928a14e35f042079a1)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.422414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.471555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe758ccb03349928a14e35f042079a1', 'request_id': 'req-9faffefb-5def-4bb1-9623-64935ddcca21'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.478089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe758ccb03349928a14e35f042079a1', 'request_id': 'req-9faffefb-5def-4bb1-9623-64935ddcca21'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.483493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe758ccb03349928a14e35f042079a1', 'request_id': 'req-9faffefb-5def-4bb1-9623-64935ddcca21'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.496809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] The token cache is being invalidate because project 6fe758ccb03349928a14e35f042079a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:48.497111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.497747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9faffefb-5def-4bb1-9623-64935ddcca21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:48.500190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1260/2549] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:48 2021] DELETE /identity/v3/projects/6fe758ccb03349928a14e35f042079a1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:48.506451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.507021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.507122 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.526556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:48.527780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:48.588664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1290/2550] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:48.597972 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.598260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.598641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.617087 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:48.618295 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:48.627305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1261/2551] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:48.631714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.642407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3e39-7cce-4820-b916-c56ecdc8e351 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.647585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.648336 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.648685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.649058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.649869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:48.650254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.652145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.664754 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1291/2552] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:48.668780 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.678751 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda24a9-829c-4247-8a33-1be25d999d29 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.683960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.684632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.685514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.685804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.687172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.689142 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.721006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1262/2553] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:48 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:48.722796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.734859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367a23e-0fa8-42bd-b1b3-b1f9e989643e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.794557 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.795898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.796328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.796619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.797468 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.801263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.823580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1292/2554] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:48 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:48.827540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.838111 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916eb594-5699-48ab-b03a-4cd0fa44839b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.842961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.843705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.844016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.844542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.845034 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.846677 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.862708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1263/2555] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:48.863855 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.876029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfacb5f-8e71-45a6-a790-cb483f39c768 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.881415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.882021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.882339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.882585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.883328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.884914 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311f60-7352-41fc-ae07-e37949323f1e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.899797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1293/2556] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:48.901273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:48.911082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3694-aead-46b0-b25a-bc1eea6de24b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:48.916870 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:48.918310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.918608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.918944 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] PATH_INFO: `/v3/projects/d37a57c1571643879588e39008b827b5/users/783558049dd54e558638dc7b071d15c2/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.934604 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37a57c1571643879588e39008b827b5, user_id=783558049dd54e558638dc7b071d15c2, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:48.938039 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:48.953792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1264/2557] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:48 2021] PUT /identity/v3/projects/d37a57c1571643879588e39008b827b5/users/783558049dd54e558638dc7b071d15c2/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:48.964583 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:48.965023 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:48.965412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:48.999378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] MFA Rules not processed for user `783558049dd54e558638dc7b071d15c2`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:49.001205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:49.070858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1294/2558] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:48 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:49.076026 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.157483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8546c8f-ada4-4a8e-a924-419ec814dd05 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.163060 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.163990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.164272 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.164599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.166104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.168152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.202174 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1265/2559] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:49 2021] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:00:49.206931 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.219986 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1403f7-4092-4082-bb09-f0eba407e707 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.290343 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.291021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.291338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.291619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.292322 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.294295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.318843 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1295/2560] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:49 2021] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:49.320440 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.330778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9292-90af-480c-aa23-e41af9d8dc89 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.335641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.336311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.336590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.336894 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.337687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.339264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.353570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1266/2561] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:49.354564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.365180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc0d9-04b3-4b3b-9a0c-0fad4c3adad4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.369940 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.370811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.371100 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.371371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] PATH_INFO: `/v3/projects/97c50ed1b21141989d823afe06930d09/users/e5184867a16d4c778d27e99c126988ce/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.386856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c50ed1b21141989d823afe06930d09, user_id=e5184867a16d4c778d27e99c126988ce, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.389617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.406479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1296/2562] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:49 2021] PUT /identity/v3/projects/97c50ed1b21141989d823afe06930d09/users/e5184867a16d4c778d27e99c126988ce/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:49.408714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.422102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e65d-cddb-4f73-a99b-e4f18dac52d1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.477534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.478265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.478549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.478822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.479560 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.481186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456621b-7800-4701-9595-c9273ffea8a9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.491859 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1267/2563] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:49 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:49.495854 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.508302 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fedd7d-814f-4852-8b77-558957c10c1e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.514802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.514942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.515282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.515564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] PATH_INFO: `/v3/projects/97c50ed1b21141989d823afe06930d09/users/e5184867a16d4c778d27e99c126988ce/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.517593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c50ed1b21141989d823afe06930d09, user_id=e5184867a16d4c778d27e99c126988ce, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.520257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.531813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1297/2564] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:49 2021] PUT /identity/v3/projects/97c50ed1b21141989d823afe06930d09/users/e5184867a16d4c778d27e99c126988ce/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:49.542192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00154946-5096-42a4-b95a-59649ff63859 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.542554 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00154946-5096-42a4-b95a-59649ff63859 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.542906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00154946-5096-42a4-b95a-59649ff63859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.569855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-00154946-5096-42a4-b95a-59649ff63859 None None] MFA Rules not processed for user `e5184867a16d4c778d27e99c126988ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:49.570970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-00154946-5096-42a4-b95a-59649ff63859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:49.646873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1268/2565] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:49 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:49.660765 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.662533 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:49.727117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec065b-dbc3-41bd-a85b-b542188c928f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.731005 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.731724 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.732078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.732428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.741978 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.743540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d752d-dd35-456d-80f5-6cfe8c916d10 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.754585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1298/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:49 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:49.820352 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00154946-5096-42a4-b95a-59649ff63859 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:49.890009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00154946-5096-42a4-b95a-59649ff63859 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:49.895019 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:49.896157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:49.896536 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:49.897024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] PATH_INFO: `/v3/users/783558049dd54e558638dc7b071d15c2` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:49.898428 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783558049dd54e558638dc7b071d15c2)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:49.900836 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:49.955552 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783558049dd54e558638dc7b071d15c2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:49.969585 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783558049dd54e558638dc7b071d15c2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:49.978598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783558049dd54e558638dc7b071d15c2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:49.980175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783558049dd54e558638dc7b071d15c2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:49.981452 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783558049dd54e558638dc7b071d15c2'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:49.999937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1269/2567] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:49 2021] DELETE /identity/v3/users/783558049dd54e558638dc7b071d15c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:50.004968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:50.005297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:50.005574 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:50.023577 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:50.024869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:50.130693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1299/2568] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:50.142397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:50.143841 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:50.222093 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820e993-f214-4483-9980-f485cfd53421 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:50.225995 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:50.226653 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:50.227025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:50.227186 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:50.240326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:50.241887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:50.254667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1270/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:50.544573 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:50.546791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:50.569610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990dc02-97be-4917-a325-d5e105d7b3af None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:50.575955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:50.577217 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:50.577594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:50.577960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] PATH_INFO: `/v3/projects/d37a57c1571643879588e39008b827b5` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:50.579317 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37a57c1571643879588e39008b827b5)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:50.581382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:50.637259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37a57c1571643879588e39008b827b5', 'request_id': 'req-1412363e-9464-45eb-84ff-280efb578471'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.646826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37a57c1571643879588e39008b827b5', 'request_id': 'req-1412363e-9464-45eb-84ff-280efb578471'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.653588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37a57c1571643879588e39008b827b5', 'request_id': 'req-1412363e-9464-45eb-84ff-280efb578471'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.668580 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] The token cache is being invalidate because project d37a57c1571643879588e39008b827b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:50.669405 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.669642 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.671764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1300/2570] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:50 2021] DELETE /identity/v3/projects/d37a57c1571643879588e39008b827b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:50.675708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:50.685493 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250016-7bad-49f4-88cb-d1fc05c1bbf0 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:50.751024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:50.751969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:50.752255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:50.752524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] PATH_INFO: `/v3/users/e5184867a16d4c778d27e99c126988ce` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:50.753791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5184867a16d4c778d27e99c126988ce)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:50.755711 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:50.810217 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5184867a16d4c778d27e99c126988ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.823696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5184867a16d4c778d27e99c126988ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.831649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5184867a16d4c778d27e99c126988ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.832453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5184867a16d4c778d27e99c126988ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.833290 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-41f5bf7d-d781-4930-807f-bcac4be71879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5184867a16d4c778d27e99c126988ce'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:50.849990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1271/2571] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:50 2021] DELETE /identity/v3/users/e5184867a16d4c778d27e99c126988ce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:51.290052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.291736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:51.305597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412363e-9464-45eb-84ff-280efb578471 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.405140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.407836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.407836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.407836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] PATH_INFO: `/v3/projects/97c50ed1b21141989d823afe06930d09` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.410099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c50ed1b21141989d823afe06930d09)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.413404 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.470567 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c50ed1b21141989d823afe06930d09', 'request_id': 'req-5e658dcc-a953-478e-9eea-f0364911f475'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:51.479661 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c50ed1b21141989d823afe06930d09', 'request_id': 'req-5e658dcc-a953-478e-9eea-f0364911f475'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:51.489701 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c50ed1b21141989d823afe06930d09', 'request_id': 'req-5e658dcc-a953-478e-9eea-f0364911f475'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:51.500915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] The token cache is being invalidate because project 97c50ed1b21141989d823afe06930d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:51.501315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:51.502061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5e658dcc-a953-478e-9eea-f0364911f475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:51.504039 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1301/2572] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:51 2021] DELETE /identity/v3/projects/97c50ed1b21141989d823afe06930d09 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:51.511393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.511693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.512022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.534222 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:51.535444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:51.605045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1272/2573] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:51.614858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.615399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.615399 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.638420 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:51.639750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:51.648611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1302/2574] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:51.652857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.665284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a1f71-aa0c-469d-9c04-d143adc42dbb None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.673122 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.673943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.674239 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.674515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.675331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:51.675646 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.677449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.690317 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1273/2575] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:51.694515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.703813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f914b-8018-4ed7-8435-7384faeb0352 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.708594 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.709668 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.710047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.710702 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.711627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.713773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.748984 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1303/2576] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:51 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:51.750654 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.760812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e072d3-a89c-46b5-ac3a-b9bef9cb17a4 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.818896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.819545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.819876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.820218 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.821082 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.823304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.844250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1274/2577] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:51 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:51.848711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.859054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dab1d-a84d-4be9-818f-6f4b578217cb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.863829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.864493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.864772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.865097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.865839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.867423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.878247 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1304/2578] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:51.882336 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.892906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0af-1fe0-4236-93b3-44256a90a264 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.897639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.898297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.898578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.898852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.899592 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.901204 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653648d-be74-48e5-8c7c-f06efbc6561a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.911691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1275/2579] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:51.915906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:51.925791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299cc74-5d12-49b6-8b23-f55549ca293b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:51.930447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:51.931325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.931610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.931889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] PATH_INFO: `/v3/projects/3a097ea7c2fa48e989d502b8f5a6e754/users/a2e1d9b6e39a41fea4826bcccde832f8/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:51.946340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a097ea7c2fa48e989d502b8f5a6e754, user_id=a2e1d9b6e39a41fea4826bcccde832f8, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:51.949048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:51.964208 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1305/2580] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:51 2021] PUT /identity/v3/projects/3a097ea7c2fa48e989d502b8f5a6e754/users/a2e1d9b6e39a41fea4826bcccde832f8/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:51.975360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:51.975831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:51.976188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.003141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] MFA Rules not processed for user `a2e1d9b6e39a41fea4826bcccde832f8`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:52.004365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:52.069751 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1276/2581] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:51 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:52.073832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.141278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe40d92-8f24-4568-a24f-3f178eac64b4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.146658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.147396 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.147747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.148093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.148867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.150878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.187110 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1306/2582] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:52 2021] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:52.188865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.202283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161c543-e6a3-4b1b-a8ff-11d1d32cba64 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.271168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.271953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.272238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.272516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.273460 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.275700 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.303417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1277/2583] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:52 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:52.308344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.319124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e306c40-495d-4e56-bcf1-330eeea53fae admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.325011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.325688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.325969 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.326564 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.327850 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.329807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.343609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1307/2584] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:52 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:52.347657 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.357900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eea40-5a47-43a1-bba1-6f7b7b6f9f90 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.362715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.363591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.363871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.364144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] PATH_INFO: `/v3/projects/98afcd2f393e4d9498491aec57fa6d00/users/c339a19403f34d5aad37aff16dd1adb7/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.380219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98afcd2f393e4d9498491aec57fa6d00, user_id=c339a19403f34d5aad37aff16dd1adb7, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.383035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.397672 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1278/2585] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:52 2021] PUT /identity/v3/projects/98afcd2f393e4d9498491aec57fa6d00/users/c339a19403f34d5aad37aff16dd1adb7/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:52.402091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.413117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9fa6a-4ff6-4123-ad96-6a569c229911 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.477630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.478659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.479209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.479585 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.480446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.482231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85336679-ef9d-4277-b061-b6eba8e09a59 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.493696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1308/2586] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:52 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:52.497911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.509956 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070bc3b-296a-47f4-96a4-17c122f51094 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.516163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.517583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.517896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.518175 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] PATH_INFO: `/v3/projects/98afcd2f393e4d9498491aec57fa6d00/users/c339a19403f34d5aad37aff16dd1adb7/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.520262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98afcd2f393e4d9498491aec57fa6d00, user_id=c339a19403f34d5aad37aff16dd1adb7, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.522961 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.541095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1279/2587] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:52 2021] PUT /identity/v3/projects/98afcd2f393e4d9498491aec57fa6d00/users/c339a19403f34d5aad37aff16dd1adb7/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:52.544744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.545177 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.546093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.576618 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] MFA Rules not processed for user `c339a19403f34d5aad37aff16dd1adb7`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:52.577885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:52.648214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1309/2588] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:52 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:52.659426 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:52.661153 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:52.717975 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568aa2-f277-4311-8dd5-db26427332f8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:52.722123 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:52.722783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:52.723063 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:52.723337 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:52.734326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:52.735760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:52.746562 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1280/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:52 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:53.086303 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.096271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7931780-cba2-44e5-9c9d-5b3e3f3f20a5 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.101330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c339a19403f34d5aad37aff16dd1adb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98afcd2f393e4d9498491aec57fa6d00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.102098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.102510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.102891 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.103901 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:53.104319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.106098 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.121956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1310/2590] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:53.126953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.136874 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c567-f945-4ee3-af3b-ac9b75c541b7 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.144373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c339a19403f34d5aad37aff16dd1adb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98afcd2f393e4d9498491aec57fa6d00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.145620 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.146043 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.146455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.147569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.151169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.190889 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1281/2591] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:53 2021] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:53.192748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.207102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ccf4-08cc-4799-b82b-2114cf304f99 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.266923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c339a19403f34d5aad37aff16dd1adb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98afcd2f393e4d9498491aec57fa6d00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.267945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.268454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.269047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.269996 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:53.270299 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.271923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.286214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1311/2592] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:53.333288 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.344712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa6d8-28d0-4897-b6c8-629924210ad4 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.349804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c339a19403f34d5aad37aff16dd1adb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98afcd2f393e4d9498491aec57fa6d00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.352029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.352323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.353114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] PATH_INFO: `/v3/projects/77767626079a4c6f8abf22f6fe5e2f38` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.354105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77767626079a4c6f8abf22f6fe5e2f38)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.356203 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.403886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77767626079a4c6f8abf22f6fe5e2f38', 'request_id': 'req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.414297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77767626079a4c6f8abf22f6fe5e2f38', 'request_id': 'req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.421794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77767626079a4c6f8abf22f6fe5e2f38', 'request_id': 'req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.436920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] The token cache is being invalidate because project 77767626079a4c6f8abf22f6fe5e2f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:53.437251 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.438096 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5ece929b-f2c0-4384-bcd7-b3dd370a9a4a tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.439704 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1282/2593] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:53 2021] DELETE /identity/v3/projects/77767626079a4c6f8abf22f6fe5e2f38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:53.655537 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.657526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:53.725268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6baa98-8dc6-4f6d-904f-0d0a339091f1 tempest-VolumeQuotaClassesTest-849777168 tempest-VolumeQuotaClassesTest-849777168-project-admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.781545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.783145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.783458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.783871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] PATH_INFO: `/v3/users/a2e1d9b6e39a41fea4826bcccde832f8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.785444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e1d9b6e39a41fea4826bcccde832f8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.787380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.833757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e1d9b6e39a41fea4826bcccde832f8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.841439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e1d9b6e39a41fea4826bcccde832f8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.854038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e1d9b6e39a41fea4826bcccde832f8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.863630 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e1d9b6e39a41fea4826bcccde832f8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.864359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e1d9b6e39a41fea4826bcccde832f8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:53.875001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1312/2594] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:53 2021] DELETE /identity/v3/users/a2e1d9b6e39a41fea4826bcccde832f8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:53.879824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.880444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.880444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.897873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:53.898999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:53.961744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1283/2595] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:53.972082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.977587 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:54.062944 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2ffe-b9d5-4032-b856-84bfc323d55b admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:54.066786 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:54.067432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:54.067716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:54.067993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:54.078802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:54.080258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:54.091197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1313/2596] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:00:54.576509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:54.581550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:54.596835 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ffb3-e26c-45a2-aea1-613d817c777a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:54.615000 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:54.616213 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:54.616564 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:54.617103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] PATH_INFO: `/v3/projects/3a097ea7c2fa48e989d502b8f5a6e754` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:54.618754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a097ea7c2fa48e989d502b8f5a6e754)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:54.620756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:54.681787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a097ea7c2fa48e989d502b8f5a6e754', 'request_id': 'req-a95e4b3e-92cf-48ce-b702-8029622e7a32'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.691362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a097ea7c2fa48e989d502b8f5a6e754', 'request_id': 'req-a95e4b3e-92cf-48ce-b702-8029622e7a32'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.698173 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a097ea7c2fa48e989d502b8f5a6e754', 'request_id': 'req-a95e4b3e-92cf-48ce-b702-8029622e7a32'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.713605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] The token cache is being invalidate because project 3a097ea7c2fa48e989d502b8f5a6e754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:54.714010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.715199 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.719181 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1284/2597] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:54 2021] DELETE /identity/v3/projects/3a097ea7c2fa48e989d502b8f5a6e754 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:54.722688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:54.737562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d947-ec7d-4129-9432-22ca8af2cdd5 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:54.818839 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:54.820074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:54.820362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:54.820654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] PATH_INFO: `/v3/users/c339a19403f34d5aad37aff16dd1adb7` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:54.822014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c339a19403f34d5aad37aff16dd1adb7)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:54.827377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:54.838600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:54.840294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:54.855069 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e4b3e-92cf-48ce-b702-8029622e7a32 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:54.860305 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:54.861300 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:54.861625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:54.861861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] PATH_INFO: `/v3/users/7d938e347ce54365be2b15647111246c` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:54.863081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d938e347ce54365be2b15647111246c)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:54.865201 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:54.876001 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c339a19403f34d5aad37aff16dd1adb7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.882769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c339a19403f34d5aad37aff16dd1adb7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.898094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c339a19403f34d5aad37aff16dd1adb7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.905315 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c339a19403f34d5aad37aff16dd1adb7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.906024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c339a19403f34d5aad37aff16dd1adb7'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.911716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1314/2598] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:54 2021] DELETE /identity/v3/users/c339a19403f34d5aad37aff16dd1adb7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:54.915810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d938e347ce54365be2b15647111246c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.928490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d938e347ce54365be2b15647111246c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.935137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d938e347ce54365be2b15647111246c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.935922 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d938e347ce54365be2b15647111246c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.936583 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d938e347ce54365be2b15647111246c'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:54.949570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1285/2599] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:54 2021] DELETE /identity/v3/users/7d938e347ce54365be2b15647111246c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:55.141263 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.142752 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.198591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.200148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.226730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1788f-051b-46ef-8f3a-20513eda0f94 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.275671 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718409-df24-465d-b048-88ae7a42f08e admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.280849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.281729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.282009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.282284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] PATH_INFO: `/v3/projects/98afcd2f393e4d9498491aec57fa6d00` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.282517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.283368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.283517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98afcd2f393e4d9498491aec57fa6d00)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.283643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.284009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] PATH_INFO: `/v3/projects/32befda3e401478ca1c53c59a412e4b0` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.285261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32befda3e401478ca1c53c59a412e4b0)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.286143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.287311 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.333918 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98afcd2f393e4d9498491aec57fa6d00', 'request_id': 'req-20765535-75e7-40ac-b3e1-060f776f31f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.335386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32befda3e401478ca1c53c59a412e4b0', 'request_id': 'req-75aee084-0641-4c80-ac8d-98ba355e6ce3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.340240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98afcd2f393e4d9498491aec57fa6d00', 'request_id': 'req-20765535-75e7-40ac-b3e1-060f776f31f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.343764 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32befda3e401478ca1c53c59a412e4b0', 'request_id': 'req-75aee084-0641-4c80-ac8d-98ba355e6ce3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.350512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32befda3e401478ca1c53c59a412e4b0', 'request_id': 'req-75aee084-0641-4c80-ac8d-98ba355e6ce3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.352486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98afcd2f393e4d9498491aec57fa6d00', 'request_id': 'req-20765535-75e7-40ac-b3e1-060f776f31f9'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.363095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] The token cache is being invalidate because project 32befda3e401478ca1c53c59a412e4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:55.363444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.364051 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.365822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1315/2600] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:55 2021] DELETE /identity/v3/projects/32befda3e401478ca1c53c59a412e4b0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:55.366008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] The token cache is being invalidate because project 98afcd2f393e4d9498491aec57fa6d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:55.366302 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.366938 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-20765535-75e7-40ac-b3e1-060f776f31f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.368451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1286/2601] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:55 2021] DELETE /identity/v3/projects/98afcd2f393e4d9498491aec57fa6d00 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:55.369641 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.371050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.376102 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587109-a17b-46d3-bfb3-da99ec12d78a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.376415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587109-a17b-46d3-bfb3-da99ec12d78a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.376769 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587109-a17b-46d3-bfb3-da99ec12d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.395269 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0b587109-a17b-46d3-bfb3-da99ec12d78a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:55.396482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0b587109-a17b-46d3-bfb3-da99ec12d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.441682 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee084-0641-4c80-ac8d-98ba355e6ce3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.447118 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.448143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.448454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.448735 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] PATH_INFO: `/v3/users/1ae55e2e6d784a738faebb4f10aa9c76` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.450127 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae55e2e6d784a738faebb4f10aa9c76)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.452192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.463690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1287/2602] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:55.472599 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.472885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.473188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.496481 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:55.498297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.511240 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1288/2603] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:55.511466 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae55e2e6d784a738faebb4f10aa9c76'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.512397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.518778 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae55e2e6d784a738faebb4f10aa9c76'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.522899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb40e-f35a-4242-aa15-9df4413609f6 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.528170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.529025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.530006 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.530310 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.531243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:00:55.531652 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.533233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae55e2e6d784a738faebb4f10aa9c76'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.533475 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.541186 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae55e2e6d784a738faebb4f10aa9c76'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.542013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae55e2e6d784a738faebb4f10aa9c76'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.546884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1289/2604] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:00:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:00:55.551222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1316/2605] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:00:55 2021] DELETE /identity/v3/users/1ae55e2e6d784a738faebb4f10aa9c76 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:55.552334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.554595 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.568449 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56783ed-839c-4568-90f3-605c8eb2575f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.637625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.638516 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.639453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.639886 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.640816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.643011 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.674707 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1290/2606] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:55 2021] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:55.676017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.687800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc101a3-7bfc-4acf-b5cf-006dbe7839bb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.749758 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.752814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:55.765101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.765923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.766268 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.766606 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.767463 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.769418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.811632 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1317/2607] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:55 2021] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:55.816349 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.828243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2473a-7d13-43ce-a47b-417b17cabfc7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.833280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.834003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.834450 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.834922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.836004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.837775 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.840590 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2e92-c0d9-4f3a-826d-9775d88260da admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.846534 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.847464 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.847742 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.848081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] PATH_INFO: `/v3/projects/02f35ba4353d428da4b41e64d973aa89` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.849430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f35ba4353d428da4b41e64d973aa89)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.851953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.854647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1318/2608] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:55.859034 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.869730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424599-fa3c-495e-9eaf-ffc00a9b83fd admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.874773 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.875711 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.875987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.876380 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.877215 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.878769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:55.889835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1319/2609] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:00:55.895733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:55.904131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f35ba4353d428da4b41e64d973aa89', 'request_id': 'req-1f10dd9a-aae7-4b9b-8721-b9f82f761514'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.906460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76d20-4475-4588-b94c-eda413e8e100 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:55.911796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f35ba4353d428da4b41e64d973aa89', 'request_id': 'req-1f10dd9a-aae7-4b9b-8721-b9f82f761514'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.917132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f35ba4353d428da4b41e64d973aa89', 'request_id': 'req-1f10dd9a-aae7-4b9b-8721-b9f82f761514'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.929066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] The token cache is being invalidate because project 02f35ba4353d428da4b41e64d973aa89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:00:55.929354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.929996 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-1f10dd9a-aae7-4b9b-8721-b9f82f761514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:00:55.931642 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1291/2610] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:00:55 2021] DELETE /identity/v3/projects/02f35ba4353d428da4b41e64d973aa89 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:55.967002 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:55.967867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:55.968144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:55.968414 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] PATH_INFO: `/v3/projects/d4f97bb432134b60a60a06d0c39b5b40/users/c694540db64f4ce08c3f3e88b86dd8b5/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:55.984643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f97bb432134b60a60a06d0c39b5b40, user_id=c694540db64f4ce08c3f3e88b86dd8b5, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:55.987886 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.003708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1320/2611] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:55 2021] PUT /identity/v3/projects/d4f97bb432134b60a60a06d0c39b5b40/users/c694540db64f4ce08c3f3e88b86dd8b5/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:56.015084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.015384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.015837 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.045325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] MFA Rules not processed for user `c694540db64f4ce08c3f3e88b86dd8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:56.046639 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:56.116423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1292/2612] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:56 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:00:56.121052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.122897 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:56.187340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac39b3-6917-49a3-8684-01b58aca49cb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.192452 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.193157 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.193443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.193722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.194439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.196351 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.224275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1321/2613] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:00:56 2021] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:56.229497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.241537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889699c-f0e3-489d-856c-ea83f81c175a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.296411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.297118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.297396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.297663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.298365 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.300275 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.321953 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1293/2614] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:00:56 2021] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:00:56.325942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.336746 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b472d1-2574-4748-8e80-404a077eb899 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.341408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.342063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.342338 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.342613 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.343347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.344921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.355505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1322/2615] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:56.360334 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.370436 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981ac1-eaca-4d03-b2ef-9655ddeffa15 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.376260 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.377193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.377473 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.377744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] PATH_INFO: `/v3/projects/37c0f3ac84404209af427478f41dddf7/users/1e483af885404895a09050e335374278/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.392145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c0f3ac84404209af427478f41dddf7, user_id=1e483af885404895a09050e335374278, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.394852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.407056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1294/2616] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:56 2021] PUT /identity/v3/projects/37c0f3ac84404209af427478f41dddf7/users/1e483af885404895a09050e335374278/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:00:56.411004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.421698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521dd38-ccf1-4fee-b636-80bb2f9605c3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.474679 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.475254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.475539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.475810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.476542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.478167 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2919f-9d67-4f50-b229-e1a9864d6627 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.488426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1323/2617] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:00:56 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:00:56.492584 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.506927 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abce38-35fa-4cd0-91d0-cd19cec659af admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.511720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.512608 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.512878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.513189 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] PATH_INFO: `/v3/projects/37c0f3ac84404209af427478f41dddf7/users/1e483af885404895a09050e335374278/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.515121 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c0f3ac84404209af427478f41dddf7, user_id=1e483af885404895a09050e335374278, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.517816 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.531455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1295/2618] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:00:56 2021] PUT /identity/v3/projects/37c0f3ac84404209af427478f41dddf7/users/1e483af885404895a09050e335374278/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:56.542684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.542974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.543258 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.574488 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] MFA Rules not processed for user `1e483af885404895a09050e335374278`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:56.575736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:56.645880 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1324/2619] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:00:56 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:56.655978 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.657759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:56.712010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00875b-9345-4134-9320-36b56b5ce942 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.715893 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.716575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.717567 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.717905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.728459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.729862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.739754 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1296/2620] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:56 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:56.814296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:56.824297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff81c86-2f69-49fe-aa02-5ea79a84b2f9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:56.829406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:56.830394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:56.830808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:56.831237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:56.897201 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:56.898663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc2247-4f63-4564-bad7-cfff59cda89d service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:56.908331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1325/2621] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:56 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:00.888188 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:00.948373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002b856-5dc4-432f-81c1-8354b167a157 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:00.952913 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:00.953826 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:00.954108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:00.954383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] PATH_INFO: `/v3/users/c694540db64f4ce08c3f3e88b86dd8b5` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:00.955570 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c694540db64f4ce08c3f3e88b86dd8b5)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:00.957497 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:01.003729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c694540db64f4ce08c3f3e88b86dd8b5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.015143 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c694540db64f4ce08c3f3e88b86dd8b5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.021495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c694540db64f4ce08c3f3e88b86dd8b5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.022164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c694540db64f4ce08c3f3e88b86dd8b5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.022755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c694540db64f4ce08c3f3e88b86dd8b5'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.035125 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1297/2622] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:00 2021] DELETE /identity/v3/users/c694540db64f4ce08c3f3e88b86dd8b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:01.039678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:01.040139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:01.040279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:01.057228 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:01.058422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:01.116635 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1326/2623] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:01.127247 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:01.128625 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:01.185431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07ed8-87c5-4fdb-ae5c-bc8eb4a742f0 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:01.189708 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:01.190353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:01.190632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:01.190905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:01.199771 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:01.201227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:01.210444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1298/2624] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:01.724397 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:01.725885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:01.738893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1fca8-e267-40aa-84e0-64a44dccf0a8 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:01.743579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:01.744439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:01.744793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:01.745024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] PATH_INFO: `/v3/projects/d4f97bb432134b60a60a06d0c39b5b40` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:01.746219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f97bb432134b60a60a06d0c39b5b40)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:01.748292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:01.793900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f97bb432134b60a60a06d0c39b5b40', 'request_id': 'req-56e67c4c-99ad-467b-9448-b6cd5934d8c8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.800970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f97bb432134b60a60a06d0c39b5b40', 'request_id': 'req-56e67c4c-99ad-467b-9448-b6cd5934d8c8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.807029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f97bb432134b60a60a06d0c39b5b40', 'request_id': 'req-56e67c4c-99ad-467b-9448-b6cd5934d8c8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.817339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] The token cache is being invalidate because project d4f97bb432134b60a60a06d0c39b5b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:01.817572 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.818205 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.819793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1327/2625] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:01 2021] DELETE /identity/v3/projects/d4f97bb432134b60a60a06d0c39b5b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:01.823881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:01.833994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b7b6a-075f-4775-8ef2-2063cca48e36 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:01.888448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:01.889891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:01.890170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:01.890448 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] PATH_INFO: `/v3/users/1e483af885404895a09050e335374278` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:01.891651 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e483af885404895a09050e335374278)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:01.893809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:01.937734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e483af885404895a09050e335374278'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.949559 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e483af885404895a09050e335374278'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.956557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e483af885404895a09050e335374278'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.957244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e483af885404895a09050e335374278'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.957852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-9736d673-0504-4cae-b64f-6505c0f25e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e483af885404895a09050e335374278'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:01.970146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1299/2626] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:01 2021] DELETE /identity/v3/users/1e483af885404895a09050e335374278 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:02.228447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.231142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:02.246291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67c4c-99ad-467b-9448-b6cd5934d8c8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.302640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.303535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.303807 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.304077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] PATH_INFO: `/v3/projects/37c0f3ac84404209af427478f41dddf7` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.305310 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c0f3ac84404209af427478f41dddf7)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.307212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.350419 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c0f3ac84404209af427478f41dddf7', 'request_id': 'req-9f293187-a670-4156-a0a3-68801cb43763'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:02.357292 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c0f3ac84404209af427478f41dddf7', 'request_id': 'req-9f293187-a670-4156-a0a3-68801cb43763'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:02.363652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c0f3ac84404209af427478f41dddf7', 'request_id': 'req-9f293187-a670-4156-a0a3-68801cb43763'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:02.373766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] The token cache is being invalidate because project 37c0f3ac84404209af427478f41dddf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:02.374055 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:02.374672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-9f293187-a670-4156-a0a3-68801cb43763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:02.376443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1328/2627] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:02 2021] DELETE /identity/v3/projects/37c0f3ac84404209af427478f41dddf7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:02.382130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.382417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.382692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.399920 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:02.401158 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:02.457602 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1300/2628] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:02.465609 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.465888 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.466160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.484774 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:02.485979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:02.494274 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1329/2629] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:02.499130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.508881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e933d-c54c-4fd0-bdf0-6f038653a49d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.513605 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.514294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.514575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.514849 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.515579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:02.515904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.517515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.528736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1301/2630] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:02.533004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.542144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6060-b7a2-4b86-b177-e510b71b929f None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.547323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.547964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.548243 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.548540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.549295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.551194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.575900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1330/2631] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:02 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:02.579988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.589721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c016-662a-4aee-b45d-ecc16ad0082f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.643716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.644299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.644580 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.644855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.645576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.647474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.666441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1302/2632] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:02 2021] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:02.671119 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.681326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4cf4-7675-41bb-950c-4280270678f7 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.686692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.687344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.687652 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.687957 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.688720 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.690621 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.700970 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1331/2633] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:02.704884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.714808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f615e-86b4-428f-bbd5-c734ee2e41ef admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.720745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.721466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.721749 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.722116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.722747 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.724322 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aff907-0b2e-458a-b2d5-359b599177f5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.735401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1303/2634] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:02.739727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.750983 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0581108-983f-4b27-976f-9152f32a16cb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.755815 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.756685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.756993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.757271 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] PATH_INFO: `/v3/projects/81cd32b593ba4a7a8b7bd6e4660c7ff9/users/c66ada792c1949fdab7e72af52a46bb4/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.770965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cd32b593ba4a7a8b7bd6e4660c7ff9, user_id=c66ada792c1949fdab7e72af52a46bb4, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.773727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.787684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1332/2635] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:02 2021] PUT /identity/v3/projects/81cd32b593ba4a7a8b7bd6e4660c7ff9/users/c66ada792c1949fdab7e72af52a46bb4/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:02.798765 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.799098 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.799332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.824811 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] MFA Rules not processed for user `c66ada792c1949fdab7e72af52a46bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:02.826058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:02.888293 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1304/2636] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:02 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:02.901038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:02.902761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:02.956876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6727e-33d5-432e-af11-839bfd9fb009 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:02.960552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5854e1cb2f34a049f72909a002dde73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:02.961272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:02.961592 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:02.961834 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:02.970464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:02.971900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1aa94-9960-4c90-822f-7904be8e43ef service glance] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:02.980470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1333/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:02 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:21.441967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:21.443370 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:21.504804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940d08-2e69-443c-b62c-1a1ace329c3a None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:21.509391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:21.510246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:21.510524 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:21.510792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] PATH_INFO: `/v3/users/79845630a58c458d982245698544f766` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:21.511969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79845630a58c458d982245698544f766)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:21.513906 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:21.562296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79845630a58c458d982245698544f766'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:21.574733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79845630a58c458d982245698544f766'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:21.582084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79845630a58c458d982245698544f766'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:21.582877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79845630a58c458d982245698544f766'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:21.583484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79845630a58c458d982245698544f766'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:21.596691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1305/2638] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:21 2021] DELETE /identity/v3/users/79845630a58c458d982245698544f766 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:21.601312 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:21.601787 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:21.601899 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:21.618878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:21.619985 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:21.676230 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1334/2639] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:21.686160 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:21.688165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:21.742812 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251fcc2-8dda-4dca-a981-fccfd7959fd1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:21.746434 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:21.747071 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:21.747345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:21.747616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:21.757233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:21.758632 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:21.768262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1306/2640] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:22.035847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.037684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:22.052456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d98a0-30a5-44e8-aee4-b6ed19a6d17a None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:22.057482 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:22.058540 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.058844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.059089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] PATH_INFO: `/v3/projects/d8a1645a6903482684dd541da05d36e7` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.060412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a1645a6903482684dd541da05d36e7)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:22.062777 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:22.107353 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a1645a6903482684dd541da05d36e7', 'request_id': 'req-ce011ea5-230a-4f14-bdd5-a98017c51d19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.115028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a1645a6903482684dd541da05d36e7', 'request_id': 'req-ce011ea5-230a-4f14-bdd5-a98017c51d19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.121279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a1645a6903482684dd541da05d36e7', 'request_id': 'req-ce011ea5-230a-4f14-bdd5-a98017c51d19'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.131961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] The token cache is being invalidate because project d8a1645a6903482684dd541da05d36e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:22.132248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.132872 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.134439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1335/2641] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:22 2021] DELETE /identity/v3/projects/d8a1645a6903482684dd541da05d36e7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:22.138804 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.148506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a794-3dca-468e-a68c-ed37c4289130 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:22.201847 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:22.202720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.203004 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.203283 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] PATH_INFO: `/v3/users/fb741d35136642cfaa659983e1bf0ddc` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.204486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb741d35136642cfaa659983e1bf0ddc)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:22.206422 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:22.254810 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb741d35136642cfaa659983e1bf0ddc'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.267067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb741d35136642cfaa659983e1bf0ddc'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.273699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb741d35136642cfaa659983e1bf0ddc'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.274418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb741d35136642cfaa659983e1bf0ddc'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.275016 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-74d4caf9-2105-4430-8f59-9268d7aae3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb741d35136642cfaa659983e1bf0ddc'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.288806 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1307/2642] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:22 2021] DELETE /identity/v3/users/fb741d35136642cfaa659983e1bf0ddc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:22.577339 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.578864 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:22.600386 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011ea5-230a-4f14-bdd5-a98017c51d19 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:22.655255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:22.657028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.657377 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.657666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] PATH_INFO: `/v3/projects/4d19c43f0b67436080750543663f59a5` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.659681 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d19c43f0b67436080750543663f59a5)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:22.660974 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:22.705214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d19c43f0b67436080750543663f59a5', 'request_id': 'req-a0c57c44-b4b3-45c7-a329-80acbc9fa160'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.712029 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d19c43f0b67436080750543663f59a5', 'request_id': 'req-a0c57c44-b4b3-45c7-a329-80acbc9fa160'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.718857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d19c43f0b67436080750543663f59a5', 'request_id': 'req-a0c57c44-b4b3-45c7-a329-80acbc9fa160'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.729608 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] The token cache is being invalidate because project 4d19c43f0b67436080750543663f59a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:22.729898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.730545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-a0c57c44-b4b3-45c7-a329-80acbc9fa160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:22.732070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1336/2643] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:22 2021] DELETE /identity/v3/projects/4d19c43f0b67436080750543663f59a5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:22.738279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.738745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.738861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.756722 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:22.757952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:22.816950 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1308/2644] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:22.825515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.825829 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.826109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.843982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:22.845240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:22.853067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1337/2645] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:22.857140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.867265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98551ac1-1c9d-4424-a086-b8162908a6f0 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:22.871851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:22.872490 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.872768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.873070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.873818 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:22.874696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:22.876527 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:22.887576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1309/2646] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 17:01:22.892413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.901598 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae16ec-7813-4985-a7b5-0dcf78322514 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:22.906889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:22.907541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:22.907808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:22.908083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:22.908788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:22.910722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:22.935406 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1338/2647] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:22 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:22.940086 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:22.949865 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67491f-13f7-4142-af58-7bc44c3e1992 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.003873 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.004465 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.004745 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.005052 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.005748 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.007658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.029145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1310/2648] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:22 2021] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:23.033276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.043308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbebf3-ac19-412c-9870-2d3904afb785 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.048008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.048654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.048926 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.049233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.049954 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.051545 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.062124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1339/2649] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:23.065929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.075582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3389874-a150-46bc-899f-f793b1097e75 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.080929 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.081587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.081863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.082140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.082861 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.084415 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f3302-8cf9-483b-be04-9f8504fa51e3 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.094557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1311/2650] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:23.098269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.107733 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221065e0-3c4c-41f3-9a06-03f36e652f02 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.112739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.113627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.113907 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.114176 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] PATH_INFO: `/v3/projects/ca471a7ef98a4b4ea82b2e24eaf997d3/users/139876f1ab864e55ba47e836cc4cf043/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.130603 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca471a7ef98a4b4ea82b2e24eaf997d3, user_id=139876f1ab864e55ba47e836cc4cf043, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.133248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.146442 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1340/2651] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:23 2021] PUT /identity/v3/projects/ca471a7ef98a4b4ea82b2e24eaf997d3/users/139876f1ab864e55ba47e836cc4cf043/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:23.162535 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.162822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.163097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.188817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] MFA Rules not processed for user `139876f1ab864e55ba47e836cc4cf043`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:23.190028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:23.249462 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1312/2652] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:23 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:23.254189 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.314530 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15785454-2283-47c5-936d-e79bb0b822d8 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.319242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.319893 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.320178 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.320460 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.321188 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.323085 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.347417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1341/2653] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:23 2021] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:23.351525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.362525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a25416-ec53-4bd7-a031-83170bae259e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.421444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.422117 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.422401 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.422675 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.423385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.425363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.445404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1313/2654] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:23 2021] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:23.449253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.459424 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac832b59-96db-49b5-a518-1cae95754aa0 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.464333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.465009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.465298 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.465575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.466363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.467942 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.478072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1342/2655] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:23.481928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.492116 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb24fb-8637-41e1-ae3a-b989880c1c37 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.497145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.498023 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.498301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.498575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] PATH_INFO: `/v3/projects/5cfd6dcee637450c95ca9f54a2aba594/users/803d8914697a442abf186aacb91f7d79/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.515226 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfd6dcee637450c95ca9f54a2aba594, user_id=803d8914697a442abf186aacb91f7d79, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.517848 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.530136 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1314/2656] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:23 2021] PUT /identity/v3/projects/5cfd6dcee637450c95ca9f54a2aba594/users/803d8914697a442abf186aacb91f7d79/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:23.534180 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.544748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcddaf-3046-42a9-b1a5-0db1bb10d2d5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.600036 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.600700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.601008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.601289 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.602022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.603614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619b0dd-ab2f-4ce4-a7a0-c415d2c72294 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.614114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1343/2657] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:23 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:23.618210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.629170 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438e31-1baf-4b2f-add3-c0197a76b0fe admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.633928 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.634793 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.635073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.635347 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] PATH_INFO: `/v3/projects/5cfd6dcee637450c95ca9f54a2aba594/users/803d8914697a442abf186aacb91f7d79/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.637345 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfd6dcee637450c95ca9f54a2aba594, user_id=803d8914697a442abf186aacb91f7d79, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.639974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.650126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1315/2658] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:23 2021] PUT /identity/v3/projects/5cfd6dcee637450c95ca9f54a2aba594/users/803d8914697a442abf186aacb91f7d79/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:23.660515 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34d94-3e87-4478-b4d7-a466d36c0ef1 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.661050 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34d94-3e87-4478-b4d7-a466d36c0ef1 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.661152 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be34d94-3e87-4478-b4d7-a466d36c0ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.687229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8be34d94-3e87-4478-b4d7-a466d36c0ef1 None None] MFA Rules not processed for user `803d8914697a442abf186aacb91f7d79`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:23.688443 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8be34d94-3e87-4478-b4d7-a466d36c0ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:23.753847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1344/2659] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:23 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:23.759926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:23.818265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47dfe-fbef-45a3-9038-003767096bd7 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:23.822827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:23.823678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.823958 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.824232 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] PATH_INFO: `/v3/users/139876f1ab864e55ba47e836cc4cf043` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.825478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=139876f1ab864e55ba47e836cc4cf043)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:23.827405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:23.871353 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139876f1ab864e55ba47e836cc4cf043'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:23.887845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139876f1ab864e55ba47e836cc4cf043'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:23.894809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139876f1ab864e55ba47e836cc4cf043'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:23.895558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139876f1ab864e55ba47e836cc4cf043'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:23.896179 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139876f1ab864e55ba47e836cc4cf043'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:23.909557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1316/2660] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:23 2021] DELETE /identity/v3/users/139876f1ab864e55ba47e836cc4cf043 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:23.914260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:23.914543 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:23.914814 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:23.932229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:23.933453 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:23.989075 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1345/2661] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:23.999074 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:24.000842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:24.067808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b28f-163a-4937-9130-b923d830b09d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:24.071582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:24.072165 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:24.072450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:24.072726 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:24.081998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:24.083411 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:24.093571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1317/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:24.597401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:24.599026 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:24.615497 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0292f-7e95-4836-a9ca-c86a3b1210fd None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:24.621945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:24.623301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:24.623301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:24.623301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] PATH_INFO: `/v3/projects/ca471a7ef98a4b4ea82b2e24eaf997d3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:24.625072 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca471a7ef98a4b4ea82b2e24eaf997d3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:24.627237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:24.672357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca471a7ef98a4b4ea82b2e24eaf997d3', 'request_id': 'req-7ad1fbed-45db-46ac-b108-984df3ed0f34'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.679407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca471a7ef98a4b4ea82b2e24eaf997d3', 'request_id': 'req-7ad1fbed-45db-46ac-b108-984df3ed0f34'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.686956 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca471a7ef98a4b4ea82b2e24eaf997d3', 'request_id': 'req-7ad1fbed-45db-46ac-b108-984df3ed0f34'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.697684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] The token cache is being invalidate because project ca471a7ef98a4b4ea82b2e24eaf997d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:24.697973 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.698647 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.700206 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1346/2663] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:24 2021] DELETE /identity/v3/projects/ca471a7ef98a4b4ea82b2e24eaf997d3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:24.704855 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:24.714355 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90d41e-b3cd-4282-a557-3b765bbbc33e service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:24.769341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:24.770202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:24.770506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:24.770779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] PATH_INFO: `/v3/users/803d8914697a442abf186aacb91f7d79` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:24.771960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803d8914697a442abf186aacb91f7d79)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:24.773898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:24.817992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803d8914697a442abf186aacb91f7d79'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.829391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803d8914697a442abf186aacb91f7d79'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.836041 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803d8914697a442abf186aacb91f7d79'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.836815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803d8914697a442abf186aacb91f7d79'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.837478 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-db43d4f8-eb94-414d-9f0b-ec24c9167279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803d8914697a442abf186aacb91f7d79'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:24.850633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1318/2664] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:24 2021] DELETE /identity/v3/users/803d8914697a442abf186aacb91f7d79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:25.112456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.114971 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.130991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1fbed-45db-46ac-b108-984df3ed0f34 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.186636 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.187490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.187772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.188045 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] PATH_INFO: `/v3/projects/5cfd6dcee637450c95ca9f54a2aba594` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.189272 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfd6dcee637450c95ca9f54a2aba594)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.191166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.237058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfd6dcee637450c95ca9f54a2aba594', 'request_id': 'req-df007e50-54e2-4086-9814-c9ebb2996a37'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:25.245493 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfd6dcee637450c95ca9f54a2aba594', 'request_id': 'req-df007e50-54e2-4086-9814-c9ebb2996a37'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:25.252278 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfd6dcee637450c95ca9f54a2aba594', 'request_id': 'req-df007e50-54e2-4086-9814-c9ebb2996a37'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:25.262143 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] The token cache is being invalidate because project 5cfd6dcee637450c95ca9f54a2aba594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:25.262434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:25.263074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-df007e50-54e2-4086-9814-c9ebb2996a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:25.264644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1347/2665] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:25 2021] DELETE /identity/v3/projects/5cfd6dcee637450c95ca9f54a2aba594 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:25.270495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.270782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.271054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.290364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:25.291539 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.349332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1319/2666] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:25.359048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.359333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.359607 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.377510 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:25.378686 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.386385 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1348/2667] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:25.390676 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.400284 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edacf3c-0e1f-4e2a-a4ce-ba1e1d6cabf3 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.404887 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.407733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.407733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.407733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.407733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:25.408220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.409649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.422441 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1320/2668] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:25.426743 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.435756 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768f5b4-b7e5-49e8-bfd2-980827a839d6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.440429 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.441101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.441382 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.441654 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.442347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.444235 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.468426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1349/2669] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:25.472513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.482246 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57813a-50dd-45d9-9d42-2c656a555cf9 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.539346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.539924 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.540202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.540474 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.541205 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.543103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.562678 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1321/2670] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:25.566883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.577470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5335a66-fcd6-42e4-81de-e090a1f1e792 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.582000 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.582644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.582921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.583194 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.583911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.585527 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.597426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1350/2671] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:01:25.601363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.611220 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6663b4b-0c86-446c-b9eb-fcfe8511881b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.615899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.616541 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.616842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.617141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.617872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.619443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7634c00-46ad-4eb1-8301-1cf8f6413f97 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.629658 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1322/2672] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:25.633732 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.644017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5c66-3129-4c6c-aacd-abbd232b4114 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.648635 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.649534 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.649811 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.650161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] PATH_INFO: `/v3/projects/02c25d676891498480318aee76be0e1d/users/32aadb6dfb81403995ab11c889cb4f2e/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.665126 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c25d676891498480318aee76be0e1d, user_id=32aadb6dfb81403995ab11c889cb4f2e, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.667553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.682415 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1351/2673] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:25 2021] PUT /identity/v3/projects/02c25d676891498480318aee76be0e1d/users/32aadb6dfb81403995ab11c889cb4f2e/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:25.692307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.692597 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.692875 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.720094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] MFA Rules not processed for user `32aadb6dfb81403995ab11c889cb4f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:25.721266 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.781299 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1323/2674] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:25.785747 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.847357 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a7f5-e62a-4ed0-89b4-42654778289a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.852195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.852856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.853179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.853458 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.854199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.856297 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.860746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.862139 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.884454 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1352/2675] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:25.885464 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.931543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095759a-5e0e-4f78-951a-c55f4a7cfdd4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.944663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40567a20-5932-4077-80f1-717288badf37 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.949489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.950166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.950434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.950707 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.951400 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.953960 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:25.974563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1353/2676] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:25 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:25.978416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:25.987644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215880-c999-47ee-bb23-9b09ddc82756 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:25.991684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.992314 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:25.992451 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.992613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.992872 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.993017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:25.993231 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:25.993506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:25.994237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:25.994689 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:25.995832 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.006582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.009867 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1354/2677] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:01:26.009984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.010708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:26.019112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1324/2678] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:01:26.020563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9a62-3783-4386-8864-09a252ee8427 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:26.025232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:26.026089 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.026378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.026644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] PATH_INFO: `/v3/projects/90cd6087b9e24b0691f405853ce6e6ee/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.041103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cd6087b9e24b0691f405853ce6e6ee, user_id=1a60f7ba5db74ecfb6e4ea5e53a4faaa, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.043772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.056590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1355/2679] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:26 2021] PUT /identity/v3/projects/90cd6087b9e24b0691f405853ce6e6ee/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:26.060596 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:26.072053 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f9b1-f509-42f0-b962-13afe33f004d service placement] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:26.129408 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:26.130114 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.130421 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.130696 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.131431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.133042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543371-03db-4e19-93da-a9806e5fca6e admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.143752 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1325/2680] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:26 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:01:26.147695 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:26.157934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78540e9c-d52d-4010-9eaf-dda13df99d5e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:26.162713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:26.163627 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.163905 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.164182 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] PATH_INFO: `/v3/projects/90cd6087b9e24b0691f405853ce6e6ee/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.166629 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cd6087b9e24b0691f405853ce6e6ee, user_id=1a60f7ba5db74ecfb6e4ea5e53a4faaa, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.169389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.181344 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1356/2681] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:26 2021] PUT /identity/v3/projects/90cd6087b9e24b0691f405853ce6e6ee/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:26.191820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.192163 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.192413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.219107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] MFA Rules not processed for user `1a60f7ba5db74ecfb6e4ea5e53a4faaa`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:26.220314 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:26.285682 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1326/2682] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:26 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:26.296345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:26.298068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:26.352672 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0b63-3249-4f4e-9bc3-bc4ea4246ea3 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:26.356373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:26.357047 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.357335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.357640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.367934 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.369426 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.386276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1357/2683] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:26 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:26.465821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:26.476419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a59b-aa4b-4602-a9d1-7821e5a7823b None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:26.480048 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:26.480680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:26.480970 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:26.481257 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:26.537952 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:26.539387 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39bac-aece-4ff5-9a2a-423955e7d61a service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:26.548737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1327/2684] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:26 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:33.258372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:33.317822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8046e-e5e2-4ddb-b0f3-e757ace36015 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:33.322506 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:33.323265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:33.323541 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:33.323809 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] PATH_INFO: `/v3/users/32aadb6dfb81403995ab11c889cb4f2e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:33.325016 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aadb6dfb81403995ab11c889cb4f2e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:33.327411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:33.371054 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aadb6dfb81403995ab11c889cb4f2e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.378337 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aadb6dfb81403995ab11c889cb4f2e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.390470 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aadb6dfb81403995ab11c889cb4f2e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.397018 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aadb6dfb81403995ab11c889cb4f2e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.397685 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aadb6dfb81403995ab11c889cb4f2e'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.403368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1358/2685] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:33 2021] DELETE /identity/v3/users/32aadb6dfb81403995ab11c889cb4f2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:33.407881 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:33.408378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:33.408505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:33.425431 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:33.426637 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:33.483383 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1328/2686] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:33.493275 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:33.494687 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:33.552103 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619861-0e72-4311-8cd1-0ea827c1093f admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:33.555719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:33.556359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:33.556640 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:33.556917 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:33.566291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:33.567722 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:33.577637 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1359/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:33.850663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:33.852150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:33.868108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b597-4e38-45cb-af36-f22868201c20 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:33.873407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:33.874843 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:33.875430 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:33.875615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] PATH_INFO: `/v3/projects/02c25d676891498480318aee76be0e1d` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:33.876868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c25d676891498480318aee76be0e1d)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:33.879112 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:33.927960 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c25d676891498480318aee76be0e1d', 'request_id': 'req-deb08f4c-1f50-44c9-ae12-07945259ad7a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.934717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c25d676891498480318aee76be0e1d', 'request_id': 'req-deb08f4c-1f50-44c9-ae12-07945259ad7a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.940669 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c25d676891498480318aee76be0e1d', 'request_id': 'req-deb08f4c-1f50-44c9-ae12-07945259ad7a'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.953743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] The token cache is being invalidate because project 02c25d676891498480318aee76be0e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:33.954032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.954710 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:33.956323 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1329/2688] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:33 2021] DELETE /identity/v3/projects/02c25d676891498480318aee76be0e1d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:33.960387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:33.969900 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f1e77-8417-4c75-82f7-7805905c1ecf service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.022261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.023115 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.023392 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.023662 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] PATH_INFO: `/v3/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.024851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a60f7ba5db74ecfb6e4ea5e53a4faaa)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.026802 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.070863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a60f7ba5db74ecfb6e4ea5e53a4faaa'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.079087 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a60f7ba5db74ecfb6e4ea5e53a4faaa'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.090725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a60f7ba5db74ecfb6e4ea5e53a4faaa'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.097744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a60f7ba5db74ecfb6e4ea5e53a4faaa'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.098467 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-de193f4e-75d4-4ea4-bd5a-3d4df59623ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a60f7ba5db74ecfb6e4ea5e53a4faaa'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.104362 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1360/2689] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:33 2021] DELETE /identity/v3/users/1a60f7ba5db74ecfb6e4ea5e53a4faaa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:34.369191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.370783 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:34.384255 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb08f4c-1f50-44c9-ae12-07945259ad7a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.442644 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.443885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.444171 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.444443 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] PATH_INFO: `/v3/projects/90cd6087b9e24b0691f405853ce6e6ee` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.445665 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cd6087b9e24b0691f405853ce6e6ee)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.447565 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.491982 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cd6087b9e24b0691f405853ce6e6ee', 'request_id': 'req-5e626f22-a60d-4683-8597-a78f723473ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.497846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cd6087b9e24b0691f405853ce6e6ee', 'request_id': 'req-5e626f22-a60d-4683-8597-a78f723473ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.503320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cd6087b9e24b0691f405853ce6e6ee', 'request_id': 'req-5e626f22-a60d-4683-8597-a78f723473ff'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.516442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] The token cache is being invalidate because project 90cd6087b9e24b0691f405853ce6e6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:34.516728 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.517384 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-5e626f22-a60d-4683-8597-a78f723473ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:34.518895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1330/2690] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:34 2021] DELETE /identity/v3/projects/90cd6087b9e24b0691f405853ce6e6ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:34.524768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.525266 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.525363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.543639 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:34.544835 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:34.606123 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1361/2691] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:34.614070 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.614301 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.614568 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.634814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:34.636045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:34.644506 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1331/2692] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:34.648918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.659022 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254b54-0f28-44d2-9735-e110ff9a66c2 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.663619 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.664259 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.664536 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.664804 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.665575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:34.665884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.667459 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.678614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1362/2693] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:34.683047 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.692716 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107e329-b52e-456e-8bfb-b673a2f8cea4 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.697739 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.698396 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.698743 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.698965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.699656 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.701598 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.730057 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1332/2694] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:34 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:34.732556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.742236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997de65-4a77-4fe6-bd26-7db69f6dee95 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.795166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.795837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.796121 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.796401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.797146 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.799048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.819525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1363/2695] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:34 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:34.823690 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.834905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af32522-7789-43c8-bc07-092c66a76189 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.839576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.840278 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.840553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.841033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.841885 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.844459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.859010 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1333/2696] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:34.860511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.871301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65dc-c4b8-4b48-ad9f-7113ed222a08 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.876968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.877693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.877976 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.878252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.879059 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.880817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41c502-d366-4560-b5ca-86fc929b483b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.896014 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1364/2697] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:34.897318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:34.907340 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f5f42-0b95-4836-8d11-6244baa3e86b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:34.912095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:34.912983 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.913270 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.913542 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] PATH_INFO: `/v3/projects/eff48899e25246d296d1f8a5c4a1a056/users/2ddb24cdbf7d4b28999899f972870297/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.928172 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff48899e25246d296d1f8a5c4a1a056, user_id=2ddb24cdbf7d4b28999899f972870297, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:34.930988 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:34.944936 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1334/2698] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:34 2021] PUT /identity/v3/projects/eff48899e25246d296d1f8a5c4a1a056/users/2ddb24cdbf7d4b28999899f972870297/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:34.956125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:34.956413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:34.956691 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:34.982916 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] MFA Rules not processed for user `2ddb24cdbf7d4b28999899f972870297`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:34.984114 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:35.050041 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1365/2699] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:34 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:35.054734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.115593 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269ec08-c711-4b1f-8b89-44bcb163c91c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.120684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.121685 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.121962 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.123126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.123126 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.125635 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.150985 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1335/2700] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:35 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:35.155061 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.165277 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db149b-6bb8-4bcf-b6f1-4de2d26bf9b9 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.218663 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.219320 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.219596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.219865 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.220588 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.222522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.241913 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1366/2701] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:35 2021] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:35.245925 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.256931 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c033f1-c5fe-4dd6-a0d7-ec29906117df admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.261571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.262230 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.262513 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.262785 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.263545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.265750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.276192 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1336/2702] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:35.280251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.290015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6120cf-cd0f-461f-a8e3-1e47a7a6455a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.294611 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.295472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.296242 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.296512 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] PATH_INFO: `/v3/projects/7d810a5e61e24207b829d1e35c02f0ca/users/9861b347b8d04304a732fbe1c3219be8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.312056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d810a5e61e24207b829d1e35c02f0ca, user_id=9861b347b8d04304a732fbe1c3219be8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.314523 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.329095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1367/2703] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:35 2021] PUT /identity/v3/projects/7d810a5e61e24207b829d1e35c02f0ca/users/9861b347b8d04304a732fbe1c3219be8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:35.333080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.342809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a5c2b-e812-4197-b31d-2f02e82b9d9a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.396416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.397064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.397344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.397616 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.398339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.399974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b0946-992e-4510-ad41-3c3995bed164 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.410028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1337/2704] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:35 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:35.414125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.424919 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b837-86e5-47e8-a4b8-97d9b4916b89 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.429628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.430507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.430791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.431067 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] PATH_INFO: `/v3/projects/7d810a5e61e24207b829d1e35c02f0ca/users/9861b347b8d04304a732fbe1c3219be8/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.433082 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d810a5e61e24207b829d1e35c02f0ca, user_id=9861b347b8d04304a732fbe1c3219be8, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.435820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.446644 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1368/2705] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:35 2021] PUT /identity/v3/projects/7d810a5e61e24207b829d1e35c02f0ca/users/9861b347b8d04304a732fbe1c3219be8/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:35.457381 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.457941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.458045 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.483871 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] MFA Rules not processed for user `9861b347b8d04304a732fbe1c3219be8`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:35.485094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:35.550414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1338/2706] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:35 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:35.561255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.563551 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:35.619238 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025156-7b80-4195-b21d-62ae3d56961e admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.622977 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.623617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.624505 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.624783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.633820 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.635248 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.644445 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1369/2707] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:35 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:35.710243 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:35.721237 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e6812-9aea-4d85-964a-929e1ac14960 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:35.726331 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:35.727326 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:35.727729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:35.728080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:35.782607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:35.784036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0414-bef5-45b4-8c4f-8be2d2668adc service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:35.792734 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1339/2708] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:35 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:36.040048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:36.099334 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac34a4-0970-4496-9b9c-adf12176c368 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:36.104003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:36.104859 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:36.105193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:36.105471 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] PATH_INFO: `/v3/users/2ddb24cdbf7d4b28999899f972870297` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:36.106664 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddb24cdbf7d4b28999899f972870297)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:36.108628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:36.152077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddb24cdbf7d4b28999899f972870297'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.159648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddb24cdbf7d4b28999899f972870297'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.170923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddb24cdbf7d4b28999899f972870297'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.178010 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddb24cdbf7d4b28999899f972870297'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.178857 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddb24cdbf7d4b28999899f972870297'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.185154 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1370/2709] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:36 2021] DELETE /identity/v3/users/2ddb24cdbf7d4b28999899f972870297 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:36.189621 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:36.189905 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:36.190176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:36.207119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:36.208294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:36.268374 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1340/2710] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:36.279102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:36.282042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:36.345794 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa98ce0-fc5a-408e-908e-7a7b8043c7b5 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:36.349448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:36.350158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:36.350448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:36.350729 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:36.360657 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:36.362207 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:36.372013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1371/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:36.633540 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:36.634963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:36.647285 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806c134-3fbd-4e1f-9475-1a86e7d3ed26 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:36.651926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:36.652817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:36.653081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:36.653339 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] PATH_INFO: `/v3/projects/eff48899e25246d296d1f8a5c4a1a056` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:36.654545 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff48899e25246d296d1f8a5c4a1a056)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:36.656499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:36.700661 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff48899e25246d296d1f8a5c4a1a056', 'request_id': 'req-0b58913b-d24f-4ff9-be32-41a292a04a7f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.707115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff48899e25246d296d1f8a5c4a1a056', 'request_id': 'req-0b58913b-d24f-4ff9-be32-41a292a04a7f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.712221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff48899e25246d296d1f8a5c4a1a056', 'request_id': 'req-0b58913b-d24f-4ff9-be32-41a292a04a7f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.724981 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] The token cache is being invalidate because project eff48899e25246d296d1f8a5c4a1a056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:36.725210 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.725867 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.727636 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1341/2712] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:36 2021] DELETE /identity/v3/projects/eff48899e25246d296d1f8a5c4a1a056 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:36.731751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:36.741519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad775da-82e3-4d29-8a89-698b5bbdeddd service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:36.794869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:36.796233 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:36.796514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:36.796799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] PATH_INFO: `/v3/users/9861b347b8d04304a732fbe1c3219be8` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:36.798008 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9861b347b8d04304a732fbe1c3219be8)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:36.799915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:36.842842 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9861b347b8d04304a732fbe1c3219be8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.849719 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9861b347b8d04304a732fbe1c3219be8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.861376 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9861b347b8d04304a732fbe1c3219be8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.867779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9861b347b8d04304a732fbe1c3219be8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.868423 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-3b312b35-0925-468b-805d-ebc0e1ecc2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9861b347b8d04304a732fbe1c3219be8'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:36.874731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1372/2713] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:36 2021] DELETE /identity/v3/users/9861b347b8d04304a732fbe1c3219be8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:37.178485 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.179937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:37.193003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58913b-d24f-4ff9-be32-41a292a04a7f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.253912 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.254692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.254977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.255248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] PATH_INFO: `/v3/projects/7d810a5e61e24207b829d1e35c02f0ca` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.256446 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d810a5e61e24207b829d1e35c02f0ca)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.258376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.304495 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d810a5e61e24207b829d1e35c02f0ca', 'request_id': 'req-aa62afbf-4925-44c0-aa2d-f5113e970f7d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:37.310868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d810a5e61e24207b829d1e35c02f0ca', 'request_id': 'req-aa62afbf-4925-44c0-aa2d-f5113e970f7d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:37.317538 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d810a5e61e24207b829d1e35c02f0ca', 'request_id': 'req-aa62afbf-4925-44c0-aa2d-f5113e970f7d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:37.330600 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] The token cache is being invalidate because project 7d810a5e61e24207b829d1e35c02f0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:37.331021 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:37.331715 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-aa62afbf-4925-44c0-aa2d-f5113e970f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:37.333663 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1342/2714] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:37 2021] DELETE /identity/v3/projects/7d810a5e61e24207b829d1e35c02f0ca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:37.339808 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.340166 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.340514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.361015 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:37.362241 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:37.421584 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1373/2715] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:37.429731 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.430017 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.430294 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.448221 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:37.449450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:37.457611 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1343/2716] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:37.461918 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.472101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f150-b223-4b58-9ee9-85ac950a1255 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.476965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.477623 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.477906 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.478185 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.478911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:37.479220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.480817 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.493196 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1374/2717] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:37.497613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.507225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf143b-0731-4845-9923-d5bcdd3d6035 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.511903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.512544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.512821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.513130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.513828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.516209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.544127 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1344/2718] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:37.545427 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.555666 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc3ed-6cae-433e-b0f7-27628f5808bc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.609011 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.609671 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.609955 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.610232 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.610921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.612826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.632280 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1375/2719] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:37.636364 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.647084 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a8910-fbff-48a6-a55e-85c5d1cd417c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.651792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.652445 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.652725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.653058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.653788 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.655986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.666526 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1345/2720] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:37.670323 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.679981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be66e5-b1e7-486d-877e-89ea5c82e65a admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.686133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.686813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.687095 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.687368 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.688101 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.689726 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e24b0-a74c-402c-be48-66193bd1fd8e admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.699593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1376/2721] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:37.704176 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.713883 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6cf9-6eb0-4a45-8302-10a880565786 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.719089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.720002 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.720241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.720517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] PATH_INFO: `/v3/projects/953ec407b9914ff0b1ae628c6a49de2c/users/82cd0ff5e5734ac8808855414f7caac4/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.735038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=953ec407b9914ff0b1ae628c6a49de2c, user_id=82cd0ff5e5734ac8808855414f7caac4, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.737768 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.750404 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1346/2722] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:37 2021] PUT /identity/v3/projects/953ec407b9914ff0b1ae628c6a49de2c/users/82cd0ff5e5734ac8808855414f7caac4/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:37.760967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.761451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.761552 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.787730 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] MFA Rules not processed for user `82cd0ff5e5734ac8808855414f7caac4`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:37.788929 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:37.850517 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1377/2723] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:37.854941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.918349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf788450-1bb9-4d61-a72b-c7b172c9db1c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:37.929884 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:37.930607 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:37.930976 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:37.931261 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:37.931992 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:37.933986 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:37.965425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1347/2724] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:37.966563 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:37.976961 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b634f4-ff42-47ab-bbff-4c22d95bf9e2 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.033345 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.033937 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.034222 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.034495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.035193 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.037144 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.060043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1378/2725] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:37 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:38.061898 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.072118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4ff9-5cfe-4762-a253-0c161761d0f5 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.077705 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.078419 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.078701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.078973 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.079712 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.081335 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.092569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1348/2726] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:38.096617 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.106763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662b12-8d4d-40f1-99af-4cac0cb989bc admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.111447 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.112331 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.112596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.112869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] PATH_INFO: `/v3/projects/160c4c6c08284abfa811ca93e28e850d/users/209f0701ca474b4c9fc69743c9482e8e/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.128048 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160c4c6c08284abfa811ca93e28e850d, user_id=209f0701ca474b4c9fc69743c9482e8e, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.130796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.144038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1379/2727] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:38 2021] PUT /identity/v3/projects/160c4c6c08284abfa811ca93e28e850d/users/209f0701ca474b4c9fc69743c9482e8e/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:38.148009 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.157864 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c99e-404f-4bf6-a2ec-0fe5bd627e49 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.198282 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.200203 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.213144 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.213869 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.214168 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.214442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.215209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.216755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.229914 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1349/2728] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:38 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:38.231366 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.241202 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b543-66d5-46f6-8130-8880d9d6c1c1 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.245964 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.246822 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.247094 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.247362 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] PATH_INFO: `/v3/projects/160c4c6c08284abfa811ca93e28e850d/users/209f0701ca474b4c9fc69743c9482e8e/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.249851 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160c4c6c08284abfa811ca93e28e850d, user_id=209f0701ca474b4c9fc69743c9482e8e, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.252750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85913796-d18c-4b91-8331-0263f07d4f16 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.262347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8d06e-0236-4104-93fa-38c7ca628c29 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.269569 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1350/2729] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:38 2021] PUT /identity/v3/projects/160c4c6c08284abfa811ca93e28e850d/users/209f0701ca474b4c9fc69743c9482e8e/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:38.274525 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.274814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.275119 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.301692 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] MFA Rules not processed for user `209f0701ca474b4c9fc69743c9482e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:38.302838 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.325199 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.326081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.326359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.326633 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] PATH_INFO: `/v3/users/c66ada792c1949fdab7e72af52a46bb4` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.328378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66ada792c1949fdab7e72af52a46bb4)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.330370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.370582 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1351/2730] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:38 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:38.376887 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66ada792c1949fdab7e72af52a46bb4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.381212 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.382713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.385448 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66ada792c1949fdab7e72af52a46bb4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.396932 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66ada792c1949fdab7e72af52a46bb4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.403535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66ada792c1949fdab7e72af52a46bb4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.404223 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-244e9f6d-5be7-4156-8fbd-608118af1f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66ada792c1949fdab7e72af52a46bb4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.410538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1380/2731] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:38 2021] DELETE /identity/v3/users/c66ada792c1949fdab7e72af52a46bb4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:38.414780 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.415160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.415446 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.434535 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:38.437104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.453502 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dad38-54f1-4a26-9e93-ed20b37617ab None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.502724 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.503267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1381/2732] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:38.503417 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.503628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.503896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.505789 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.513296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.514655 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.563406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.564744 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.568858 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f41e-f813-4600-8790-b3b9d4567fbe None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.572547 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.573219 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.573501 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.573640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1352/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:38 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:38.573791 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.583111 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.584539 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8da64-cede-4258-9dad-cd02dda2ab27 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.594094 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1382/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:01:38.865943 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:38.867444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:38.882407 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746017c7-2768-423c-8957-cee7de39a394 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:38.888274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:38.889252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.889537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.889888 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] PATH_INFO: `/v3/projects/81cd32b593ba4a7a8b7bd6e4660c7ff9` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.891067 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cd32b593ba4a7a8b7bd6e4660c7ff9)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:38.893164 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:38.940815 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cd32b593ba4a7a8b7bd6e4660c7ff9', 'request_id': 'req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.947416 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cd32b593ba4a7a8b7bd6e4660c7ff9', 'request_id': 'req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.953259 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cd32b593ba4a7a8b7bd6e4660c7ff9', 'request_id': 'req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.965459 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] The token cache is being invalidate because project 81cd32b593ba4a7a8b7bd6e4660c7ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:38.965753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.966405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-54c56f00-6c30-4f92-80bc-d43cdbcd1e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:38.968486 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1353/2735] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:38 2021] DELETE /identity/v3/projects/81cd32b593ba4a7a8b7bd6e4660c7ff9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:38.974782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:38.975253 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:38.975370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:38.993174 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:38.994379 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:39.051525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1383/2736] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:39.059152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.059442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.059721 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.078145 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:39.079273 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:39.088107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1354/2737] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:39.092979 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.102710 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab569c-6b2e-4c73-9d73-3d4196fec3be None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.107696 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.108407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.108689 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.108999 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.109748 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:39.110083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.111742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.127967 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1384/2738] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:39.129911 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.140274 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a87cd4-e3ef-4db8-9aef-ec8e3e0c9932 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.145062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.145718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.145999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.146268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.146963 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.148857 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.179879 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1355/2739] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:39 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:39.180993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.190751 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a499-9147-425b-8c87-cb7eaab63f39 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.258797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.259514 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.259793 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.260068 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.260784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.262727 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.283912 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1385/2740] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:39 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:39.288137 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.298187 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd858cea-31a6-4b65-8895-a76225ee4a8a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.302831 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.303476 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.303760 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.304032 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.304757 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.306378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.316808 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1356/2741] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:39.320885 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.331077 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f38f-13d0-4879-b293-65a860ced387 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.335575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.336209 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.336487 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.336759 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.337516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.339285 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a494-c9df-4d10-adee-d0806e9e3678 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.349347 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1386/2742] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:39.353444 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.363233 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66b5f-405a-4799-b001-bd6533d32d5c admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.368024 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.368892 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.369207 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.369480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] PATH_INFO: `/v3/projects/2c11bc95549f40dca1a5666819665ebf/users/43e3bf1acf2d43e2a130545e1754f06c/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.386115 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c11bc95549f40dca1a5666819665ebf, user_id=43e3bf1acf2d43e2a130545e1754f06c, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.390555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.405575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1357/2743] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:39 2021] PUT /identity/v3/projects/2c11bc95549f40dca1a5666819665ebf/users/43e3bf1acf2d43e2a130545e1754f06c/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:39.416496 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271023-5670-4c62-9971-09bafa2768da None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.416742 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271023-5670-4c62-9971-09bafa2768da None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.417197 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271023-5670-4c62-9971-09bafa2768da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.444526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-8e271023-5670-4c62-9971-09bafa2768da None None] MFA Rules not processed for user `43e3bf1acf2d43e2a130545e1754f06c`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:39.445772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8e271023-5670-4c62-9971-09bafa2768da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:39.505700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1387/2744] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:39 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:39.516390 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:39.518141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:39.572714 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3d267-0f0c-468c-8268-24ec8d276a22 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:39.576492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:39.577825 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:39.578108 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:39.578379 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:39.587015 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:39.588378 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0170fd-347f-436a-852d-37a619d4ce5d service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:39.597482 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1358/2745] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:39 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:41.120591 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271023-5670-4c62-9971-09bafa2768da None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:41.122301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-8e271023-5670-4c62-9971-09bafa2768da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:41.201130 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271023-5670-4c62-9971-09bafa2768da None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:41.206120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:41.206987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:41.207325 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:41.207562 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] PATH_INFO: `/v3/users/82cd0ff5e5734ac8808855414f7caac4` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:41.208761 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cd0ff5e5734ac8808855414f7caac4)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:41.210716 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:41.277408 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cd0ff5e5734ac8808855414f7caac4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:41.286212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cd0ff5e5734ac8808855414f7caac4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:41.300462 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cd0ff5e5734ac8808855414f7caac4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:41.307783 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cd0ff5e5734ac8808855414f7caac4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:41.312306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0b4980e8-673f-4675-8452-026547d99547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cd0ff5e5734ac8808855414f7caac4'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:41.322874 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1388/2746] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:41 2021] DELETE /identity/v3/users/82cd0ff5e5734ac8808855414f7caac4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:41.324846 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:41.325341 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:41.325470 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:41.344296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:41.345369 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:41.417549 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:41.419910 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:41.421006 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:41.427558 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1359/2747] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:41.437926 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:41.439409 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:41.442995 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] MFA Rules not processed for user `0fb66c98af9c4aefaa046ab6fe2e54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:41.444251 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:41.503891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a30ed-4d70-4c7d-a694-88040cb00b35 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:41.507823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:41.508227 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:41.508508 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:41.508839 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:41.514837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1389/2748] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:41 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:41.522543 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:41.524044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:41.534814 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1360/2749] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:01:42.016923 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:42.018456 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:42.033104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d805d2-e686-4fee-be70-04f40f619a99 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:42.037904 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:42.038816 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.039134 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.039372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] PATH_INFO: `/v3/projects/953ec407b9914ff0b1ae628c6a49de2c` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.040596 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] RBAC: Authorizing `identity:delete_project(project_id=953ec407b9914ff0b1ae628c6a49de2c)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:42.042556 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:42.095318 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953ec407b9914ff0b1ae628c6a49de2c', 'request_id': 'req-1bbea2e9-8060-4522-9ea7-4b960cce655d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.103214 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953ec407b9914ff0b1ae628c6a49de2c', 'request_id': 'req-1bbea2e9-8060-4522-9ea7-4b960cce655d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.110498 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953ec407b9914ff0b1ae628c6a49de2c', 'request_id': 'req-1bbea2e9-8060-4522-9ea7-4b960cce655d'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.120998 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] The token cache is being invalidate because project 953ec407b9914ff0b1ae628c6a49de2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:42.121624 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.121992 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.124171 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1390/2750] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:42 2021] DELETE /identity/v3/projects/953ec407b9914ff0b1ae628c6a49de2c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:42.129458 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:42.138984 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0751a-6736-4f50-a3fd-2e3a48ab1338 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:42.194563 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:42.195509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.195787 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.196058 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] PATH_INFO: `/v3/users/209f0701ca474b4c9fc69743c9482e8e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.197318 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209f0701ca474b4c9fc69743c9482e8e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:42.199248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:42.254713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209f0701ca474b4c9fc69743c9482e8e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.277014 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209f0701ca474b4c9fc69743c9482e8e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.284062 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209f0701ca474b4c9fc69743c9482e8e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.284891 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209f0701ca474b4c9fc69743c9482e8e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.285684 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-96a21145-d186-4f60-9faa-f5ffba2426e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209f0701ca474b4c9fc69743c9482e8e'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.300357 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1361/2751] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:42 2021] DELETE /identity/v3/users/209f0701ca474b4c9fc69743c9482e8e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:42.626750 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:42.628431 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:42.643988 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbea2e9-8060-4522-9ea7-4b960cce655d admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:42.725390 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:42.726422 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.726713 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.727064 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] PATH_INFO: `/v3/projects/160c4c6c08284abfa811ca93e28e850d` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.728796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] RBAC: Authorizing `identity:delete_project(project_id=160c4c6c08284abfa811ca93e28e850d)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:42.730481 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:42.787805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160c4c6c08284abfa811ca93e28e850d', 'request_id': 'req-da2ed562-c817-46fb-81a1-2ba0f0d2159b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.798190 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160c4c6c08284abfa811ca93e28e850d', 'request_id': 'req-da2ed562-c817-46fb-81a1-2ba0f0d2159b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.806159 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160c4c6c08284abfa811ca93e28e850d', 'request_id': 'req-da2ed562-c817-46fb-81a1-2ba0f0d2159b'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.817525 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] The token cache is being invalidate because project 160c4c6c08284abfa811ca93e28e850d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73568) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:42.817964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.818678 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-da2ed562-c817-46fb-81a1-2ba0f0d2159b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:42.820125 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1391/2752] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:42 2021] DELETE /identity/v3/projects/160c4c6c08284abfa811ca93e28e850d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:42.825994 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.826488 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.827107 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.845746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:42.847344 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:42.912265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1362/2753] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:42.920295 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.920723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.921112 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.939805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:42.941058 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:42.949141 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1392/2754] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:42.953903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:42.963312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a9c0-0430-47aa-887d-67ea95ffa855 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:42.968755 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:42.969442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:42.969833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:42.970105 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:42.970823 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73567) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:42.971128 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:42.972701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:42.984733 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1363/2755] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:42.989160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:42.998192 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb2e8-2a87-4f8a-84e8-d3282ec2d5f6 None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.003187 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.003826 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.004104 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.004373 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.005220 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.007363 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.041522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1393/2756] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:42 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:43.046974 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.057649 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521281f-bd1c-42b7-b09c-b39227632e1a admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.114072 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.114762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.115038 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.115307 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.115997 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.117969 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.138420 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1364/2757] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:43.143078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.153191 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684da86-9deb-43a5-bc5e-8b8f031eb651 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.157844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.158490 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.158771 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.159043 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.159772 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.161398 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.171508 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1394/2758] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:43.175313 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.185291 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad7ac-d0d7-4fb1-b4f5-9b85dc5fd7ca admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.190483 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.191130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.191410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.191683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.192414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.194022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bdd03-c9e8-4284-97cf-76dd3230577a admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.204350 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1365/2759] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:43.208267 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.217911 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d21b-ec12-4788-bffb-f1ae3eb60089 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.222479 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.223335 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.223616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.223895 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] PATH_INFO: `/v3/projects/f5b6b53b4b3e470890f27607f79ad6b0/users/846bc0bf3b8a4051820f8cfc43f96ecc/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.239042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b6b53b4b3e470890f27607f79ad6b0, user_id=846bc0bf3b8a4051820f8cfc43f96ecc, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.241697 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.254883 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1395/2760] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:43 2021] PUT /identity/v3/projects/f5b6b53b4b3e470890f27607f79ad6b0/users/846bc0bf3b8a4051820f8cfc43f96ecc/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:43.273489 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad899-3005-4692-8305-4548853602ad None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.273778 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad899-3005-4692-8305-4548853602ad None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.274056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdad899-3005-4692-8305-4548853602ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.303951 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8fdad899-3005-4692-8305-4548853602ad None None] MFA Rules not processed for user `846bc0bf3b8a4051820f8cfc43f96ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:43.305103 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8fdad899-3005-4692-8305-4548853602ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:43.372081 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1366/2761] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 17:01:43.377526 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.441260 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3f3a-a5fa-4370-9684-2cfd0df8fa62 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.446158 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.446822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.447108 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.447381 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.448080 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.450348 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.481319 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1396/2762] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:43.485223 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdad899-3005-4692-8305-4548853602ad None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.497104 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdad899-3005-4692-8305-4548853602ad None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.562904 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.563576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.563852 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.564152 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.564863 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.566796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.588177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1367/2763] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:43.595521 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.605963 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9da1-3c02-4f1a-936d-c143c0b494e6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.611305 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.612038 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.612389 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.612840 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.613674 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.615265 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.630276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1397/2764] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:43.631298 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.641518 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bfef-bff1-438d-b3f0-d51f24848f88 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.646575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.647231 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.647505 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.647776 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.648504 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.650110 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e257c-1712-4117-beb7-cdbce6829d1b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.663264 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1368/2765] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:43.664465 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.675472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9fe26-f04b-4778-be53-c21d763f0c59 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.680211 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.681140 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.681417 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.681684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] PATH_INFO: `/v3/projects/8c05241e53ec44508d0d90d66c5ccd3e/users/8c403006337e4ec18b4171fbfc270562/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.698938 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c05241e53ec44508d0d90d66c5ccd3e, user_id=8c403006337e4ec18b4171fbfc270562, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.701755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.715063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1398/2766] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:43 2021] PUT /identity/v3/projects/8c05241e53ec44508d0d90d66c5ccd3e/users/8c403006337e4ec18b4171fbfc270562/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:43.726211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.726668 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.727242 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.758297 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] MFA Rules not processed for user `8c403006337e4ec18b4171fbfc270562`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:43.759862 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:43.830896 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1369/2767] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:43.835269 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.914898 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52110d8-ddac-46b1-9c6a-0379894caa92 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:43.921097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:43.921766 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:43.922052 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:43.922330 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:43.923102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:43.930600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:43.965291 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1399/2768] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:43.969729 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:43.983824 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7ceea-2728-4e02-9bb6-3425dbf1ba4e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.050150 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.050817 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.051492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.051781 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] PATH_INFO: `/v3/users` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.052640 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.054854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.080410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1370/2769] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:43 2021] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:44.084626 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:44.116731 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02901cf2-f3c7-4dd4-80b7-51b04ca36d96 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.133371 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.134079 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.134366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.134645 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.135394 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.137391 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.157179 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1400/2770] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:44.159044 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:44.180068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eadff-16c0-4005-8c5a-d40c23070243 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.185587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.186544 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.186821 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.187089 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] PATH_INFO: `/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a/users/6fd86f62a9d84b9caef4f2d3143731df/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.218008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8c67a9e585428fa5a02acbfd7bc80a, user_id=6fd86f62a9d84b9caef4f2d3143731df, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.221405 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.240131 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1371/2771] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:44 2021] PUT /identity/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a/users/6fd86f62a9d84b9caef4f2d3143731df/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:44.243744 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:44.255261 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b62bb-0235-42f5-a850-f0fe0f84ac62 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.341073 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.341755 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.342013 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.342856 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.343673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.345308 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8a440-375b-4c78-aa7a-cf2f041d7aa8 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.357884 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1401/2772] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:44.362499 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:44.375385 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67dd9b-0020-4efd-9b2c-76e651588ae8 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.380553 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.381480 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.381756 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.382022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] PATH_INFO: `/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a/users/6fd86f62a9d84b9caef4f2d3143731df/roles/4fc92071567747e89f2e86ecec30229e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.384256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8c67a9e585428fa5a02acbfd7bc80a, user_id=6fd86f62a9d84b9caef4f2d3143731df, role_id=4fc92071567747e89f2e86ecec30229e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.387076 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.409169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1372/2773] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:44 2021] PUT /identity/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a/users/6fd86f62a9d84b9caef4f2d3143731df/roles/4fc92071567747e89f2e86ecec30229e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:44.412402 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.412889 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.413421 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.444670 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] MFA Rules not processed for user `6fd86f62a9d84b9caef4f2d3143731df`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:44.446372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:44.518993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1402/2774] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:44 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:44.531410 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:44.534106 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:44.596915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd23e1-bab1-49af-ab3f-a32ea4d27306 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:44.613178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:44.613895 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:44.617256 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:44.617586 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:44.712056 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:44.713720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:44.733588 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1373/2775] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:44 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:46.360511 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:46.362355 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:46.375597 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaab87a-8ff6-4ce9-bcbc-7951fbb42b0c None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:46.381849 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:46.382965 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:46.383444 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:46.383922 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:46.444195 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:46.445579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:46.455024 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1403/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:46 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:46.974791 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:46.983162 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf603f74-9aea-49d1-8899-2fda29664a97 service cinder] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:46.986827 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:46.987455 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:46.987736 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:46.988008 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:46.996709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:46.998157 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3398f-6d6a-41e0-b28d-b8cb8e09cf2d service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:47.010723 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1374/2777] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:46 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:49.960056 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:49.961516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:50.024519 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b651-04c6-46d9-bb24-df5c009e65c2 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:50.029183 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:50.030044 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.030327 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.030600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] PATH_INFO: `/v3/users/43e3bf1acf2d43e2a130545e1754f06c` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:50.031806 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e3bf1acf2d43e2a130545e1754f06c)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:50.033769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:50.079451 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e3bf1acf2d43e2a130545e1754f06c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.086237 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e3bf1acf2d43e2a130545e1754f06c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.097538 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e3bf1acf2d43e2a130545e1754f06c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.103869 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e3bf1acf2d43e2a130545e1754f06c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.104507 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e3bf1acf2d43e2a130545e1754f06c'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.110489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1404/2778] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:49 2021] DELETE /identity/v3/users/43e3bf1acf2d43e2a130545e1754f06c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:50.114900 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.115349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.115450 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:50.132629 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:50.133876 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:50.190613 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1375/2779] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:50.200866 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:50.202279 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:50.257240 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325021e-6961-4e3d-8378-242fd7cfc6e4 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:50.260962 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:50.261612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.261890 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.262161 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:50.271202 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:50.272616 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:50.281831 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1405/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:50.542191 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:50.543853 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:50.561954 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a48d7-a118-46c6-a711-0ea01c1d942d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:50.573805 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:50.574664 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.574948 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.575225 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] PATH_INFO: `/v3/projects/2c11bc95549f40dca1a5666819665ebf` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:50.576418 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c11bc95549f40dca1a5666819665ebf)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:50.578363 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:50.623998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c11bc95549f40dca1a5666819665ebf', 'request_id': 'req-7b3a2ff9-060f-4114-9c44-f0099e8ad408'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.630190 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c11bc95549f40dca1a5666819665ebf', 'request_id': 'req-7b3a2ff9-060f-4114-9c44-f0099e8ad408'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.635633 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c11bc95549f40dca1a5666819665ebf', 'request_id': 'req-7b3a2ff9-060f-4114-9c44-f0099e8ad408'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.647433 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] The token cache is being invalidate because project 2c11bc95549f40dca1a5666819665ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:50.647719 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.648333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7b3a2ff9-060f-4114-9c44-f0099e8ad408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.649877 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1376/2781] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:50 2021] DELETE /identity/v3/projects/2c11bc95549f40dca1a5666819665ebf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:50.835120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:50.836648 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:50.850784 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18025cf-c10c-478c-8b3d-3f54f3a0d6cb service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:50.907964 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:50.908828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.909139 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.909418 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] PATH_INFO: `/v3/users/846bc0bf3b8a4051820f8cfc43f96ecc` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:50.910612 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846bc0bf3b8a4051820f8cfc43f96ecc)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:50.912522 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:50.955799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846bc0bf3b8a4051820f8cfc43f96ecc'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.963004 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846bc0bf3b8a4051820f8cfc43f96ecc'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.974863 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846bc0bf3b8a4051820f8cfc43f96ecc'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.981359 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846bc0bf3b8a4051820f8cfc43f96ecc'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.981993 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846bc0bf3b8a4051820f8cfc43f96ecc'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:50.988387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1406/2782] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:50 2021] DELETE /identity/v3/users/846bc0bf3b8a4051820f8cfc43f96ecc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:50.992858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:50.993296 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:50.993576 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:51.010899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:51.012095 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:51.067393 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1377/2783] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:51.077326 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:51.079254 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:51.133378 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3728-125a-4ea9-8e3d-64bd800b5464 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:51.137020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:51.137659 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:51.138413 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:51.138694 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:51.148124 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:51.149610 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:51.159440 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1407/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:51.425035 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:51.426484 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:51.438537 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d285-6e60-4b73-8105-5ac8bb0564f6 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:51.443245 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:51.444068 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:51.444346 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:51.444628 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] PATH_INFO: `/v3/projects/f5b6b53b4b3e470890f27607f79ad6b0` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:51.445868 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b6b53b4b3e470890f27607f79ad6b0)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:51.447763 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:51.493442 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b6b53b4b3e470890f27607f79ad6b0', 'request_id': 'req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.499349 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b6b53b4b3e470890f27607f79ad6b0', 'request_id': 'req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.505402 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b6b53b4b3e470890f27607f79ad6b0', 'request_id': 'req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.517713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] The token cache is being invalidate because project f5b6b53b4b3e470890f27607f79ad6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:51.517999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.518615 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.520130 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1378/2785] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:51 2021] DELETE /identity/v3/projects/f5b6b53b4b3e470890f27607f79ad6b0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:51.524132 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:51.534503 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce77a7-e917-4ebb-bcdd-9791ec11534e service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:51.592416 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:51.593306 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:51.593579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:51.593844 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] PATH_INFO: `/v3/users/8c403006337e4ec18b4171fbfc270562` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:51.595028 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c403006337e4ec18b4171fbfc270562)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:51.596927 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:51.640714 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c403006337e4ec18b4171fbfc270562'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.647129 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c403006337e4ec18b4171fbfc270562'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.658708 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c403006337e4ec18b4171fbfc270562'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.665296 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c403006337e4ec18b4171fbfc270562'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.665921 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c403006337e4ec18b4171fbfc270562'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:51.671561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1408/2786] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:51 2021] DELETE /identity/v3/users/8c403006337e4ec18b4171fbfc270562 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:51.933453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:51.934890 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:51.948819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b8b2-e412-484d-ab1a-f08a8a385c5b admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.005304 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.006185 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.006511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.006820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] PATH_INFO: `/v3/projects/8c05241e53ec44508d0d90d66c5ccd3e` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.008792 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c05241e53ec44508d0d90d66c5ccd3e)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.010909 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.056406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c05241e53ec44508d0d90d66c5ccd3e', 'request_id': 'req-081d8c8e-1626-4802-bf59-3a5e35f69198'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.063033 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c05241e53ec44508d0d90d66c5ccd3e', 'request_id': 'req-081d8c8e-1626-4802-bf59-3a5e35f69198'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.068265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c05241e53ec44508d0d90d66c5ccd3e', 'request_id': 'req-081d8c8e-1626-4802-bf59-3a5e35f69198'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.080090 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] The token cache is being invalidate because project 8c05241e53ec44508d0d90d66c5ccd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:52.080382 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.081025 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.082594 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1379/2787] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:51 2021] DELETE /identity/v3/projects/8c05241e53ec44508d0d90d66c5ccd3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:52.086553 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.087945 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:52.101063 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa181f-4b5c-4114-b4e5-18aec456f143 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.155091 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.156489 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.156769 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.157078 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] PATH_INFO: `/v3/users/6fd86f62a9d84b9caef4f2d3143731df` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.158333 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd86f62a9d84b9caef4f2d3143731df)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.160328 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.206093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd86f62a9d84b9caef4f2d3143731df'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.214120 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd86f62a9d84b9caef4f2d3143731df'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.226221 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd86f62a9d84b9caef4f2d3143731df'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.233109 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd86f62a9d84b9caef4f2d3143731df'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.233822 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-772a3399-f874-488f-9404-41c78b3090ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd86f62a9d84b9caef4f2d3143731df'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.240225 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1409/2788] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:01:52 2021] DELETE /identity/v3/users/6fd86f62a9d84b9caef4f2d3143731df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:52.508774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.510400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:52.524725 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8c8e-1626-4802-bf59-3a5e35f69198 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.580790 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.581693 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.581977 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.582252 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] PATH_INFO: `/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.583579 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8c67a9e585428fa5a02acbfd7bc80a)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.585551 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.631333 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8c67a9e585428fa5a02acbfd7bc80a', 'request_id': 'req-e72da632-c75a-4ef0-a7a8-370c6f790b67'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.637193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8c67a9e585428fa5a02acbfd7bc80a', 'request_id': 'req-e72da632-c75a-4ef0-a7a8-370c6f790b67'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.642819 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8c67a9e585428fa5a02acbfd7bc80a', 'request_id': 'req-e72da632-c75a-4ef0-a7a8-370c6f790b67'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.656578 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] The token cache is being invalidate because project 6e8c67a9e585428fa5a02acbfd7bc80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:01:52.656858 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.657549 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-e72da632-c75a-4ef0-a7a8-370c6f790b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:01:52.659211 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1380/2789] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:01:52 2021] DELETE /identity/v3/projects/6e8c67a9e585428fa5a02acbfd7bc80a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 17:01:52.664982 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.665276 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.665554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.682785 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:52.683991 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:52.743698 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1410/2790] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:52.753146 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.753439 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.753720 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.772406 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:52.773643 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:52.782262 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1381/2791] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:52.786782 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.796224 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f2848-b603-4f85-9789-943ff1c513eb None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.800847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.801516 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.801799 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.802069 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.802797 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73568) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 17:01:52.803102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.804673 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.819477 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1411/2792] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 12 17:01:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 17:01:52.820575 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.830267 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2baa6-f680-4bb8-85a4-4f64293fa6a7 None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.834917 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.835557 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.835842 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.836118 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] PATH_INFO: `/v3/projects` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.836828 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.838753 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.863709 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1382/2793] 10.222.0.42 () {60 vars in 1152 bytes} [Tue Oct 12 17:01:52 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 17:01:52.867725 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.878245 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f09ad-c588-40a3-bcde-698f1d72a6d6 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.930486 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.931142 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.931425 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.931700 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] PATH_INFO: `/v3/users` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.932387 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.934340 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.955213 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1412/2794] 10.222.0.42 () {60 vars in 1143 bytes} [Tue Oct 12 17:01:52 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 17:01:52.959312 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:52.969638 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca17e8-3751-4d17-b223-a8b54955aefd admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:52.974380 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:52.975177 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:52.975457 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:52.975730 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] PATH_INFO: `/v3/roles` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:52.976453 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:52.978080 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:52.988209 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1383/2795] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 17:01:52.992042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:53.002244 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572940-9835-49b9-a641-442826f96aeb admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:53.007099 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:53.007738 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:53.008017 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:53.008287 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:53.009042 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:53.010614 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5d280-3568-44ab-bab9-ca791223bdd6 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:53.020736 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1413/2796] 10.222.0.42 () {58 vars in 1121 bytes} [Tue Oct 12 17:01:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 17:01:53.024687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:53.034377 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428096f-f0f4-493e-b991-5f251fba8fde admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:53.039169 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:53.039966 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] REQUEST_METHOD: `PUT` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:53.040248 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:53.040519 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] PATH_INFO: `/v3/projects/ee8af7ba39fb4329a2a331f5139cfacf/users/e60e6a888a5a4f8b9a0be145bca7cb85/roles/910660db5a7a400c8e4accdc9a348623` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:53.054699 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8af7ba39fb4329a2a331f5139cfacf, user_id=e60e6a888a5a4f8b9a0be145bca7cb85, role_id=910660db5a7a400c8e4accdc9a348623)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:53.057397 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:53.071395 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1384/2797] 10.222.0.42 () {60 vars in 1482 bytes} [Tue Oct 12 17:01:53 2021] PUT /identity/v3/projects/ee8af7ba39fb4329a2a331f5139cfacf/users/e60e6a888a5a4f8b9a0be145bca7cb85/roles/910660db5a7a400c8e4accdc9a348623 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:01:53.076472 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02167-65f3-4aaa-8608-ff238e73745d None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:53.076763 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02167-65f3-4aaa-8608-ff238e73745d None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:53.077093 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02167-65f3-4aaa-8608-ff238e73745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:53.095476 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-5bd02167-65f3-4aaa-8608-ff238e73745d None None] MFA Rules not processed for user `12c2b7d3088e4259a65e864f8c35d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:53.096768 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5bd02167-65f3-4aaa-8608-ff238e73745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:53.154737 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1414/2798] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:53.164794 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:53.166587 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:53.223050 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523803a-2fb3-4972-a8c6-b3b2dd060faf admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:53.226738 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:53.227424 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:53.227713 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:53.227990 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:53.237320 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:53.238782 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:53.247907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1385/2799] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:01:53.838548 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc196-c4e4-4590-b3c2-a16688339389 None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:53.838836 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc196-c4e4-4590-b3c2-a16688339389 None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:53.839135 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acc196-c4e4-4590-b3c2-a16688339389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:53.869593 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-d7acc196-c4e4-4590-b3c2-a16688339389 None None] MFA Rules not processed for user `e60e6a888a5a4f8b9a0be145bca7cb85`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:53.870915 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-d7acc196-c4e4-4590-b3c2-a16688339389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:53.933987 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1415/2800] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:01:53.943820 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:01:53.945268 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:54.001193 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5f627-f12d-4461-aa96-1540ece1b3e5 service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:01:54.004807 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:01:54.005487 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:54.005764 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:54.006036 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:54.014591 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:01:54.016517 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362648-2bd6-4ec4-960e-a9bdee90d783 service cinder] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:01:54.025507 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1386/2801] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:01:53 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:01:55.386053 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] REQUEST_METHOD: `POST` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:01:55.386575 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:01:55.386688 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:01:55.403805 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.auth.core [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] MFA Rules not processed for user `e60e6a888a5a4f8b9a0be145bca7cb85`. Rule list: `[]` (Enabled: `True`). {{(pid=73568) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:01:55.405037 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:01:55.412620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1416/2802] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:01:55 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:02:59.152509 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:59.153141 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:59.153550 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:59.172717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] MFA Rules not processed for user `e60e6a888a5a4f8b9a0be145bca7cb85`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:02:59.173955 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:59.180899 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1387/2803] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:02:59 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:03:27.400813 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:27.410412 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0b75f-c8b3-4631-8a15-cd5db175ebaa None None] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:27.414160 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:27.414801 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:27.415083 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:27.415358 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:27.417175 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:27.486009 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:27.487469 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:27.498951 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1417/2804] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:27 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:30.062311 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:30.072667 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d3180-d5ea-4013-b809-dc62728fd80d None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:30.076271 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:30.076903 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:30.077244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:30.077521 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:30.079265 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:30.092999 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:30.094514 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96da184-f9e2-4541-8854-889fae188d0b service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:30.105332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1388/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:49.342561 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:49.351003 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4996b10-3405-4304-8212-7e91f949f240 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:49.354628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1052f3aba4c24b1aab7ec4ddf46cf820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:49.355252 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:49.355528 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:49.355800 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:49.357554 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:49.413316 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:49.414779 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:49.424097 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1418/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:49 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:56.212360 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] REQUEST_METHOD: `POST` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:56.212845 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:56.213073 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:56.232429 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.auth.core [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] MFA Rules not processed for user `0fb66c98af9c4aefaa046ab6fe2e54d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73567) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:03:56.233796 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:56.243687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1389/2807] 10.222.0.42 () {58 vars in 957 bytes} [Tue Oct 12 17:03:56 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:03:56.558411 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:56.567828 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae57cae-069c-48b4-bf3a-4aeb99512280 service cinder] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:56.571434 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:56.572074 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:56.572366 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:56.572643 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:56.574542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:56.584579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:56.586046 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:56.594432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1419/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:57.033641 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:57.034941 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:57.102250 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767ba9-4028-4daf-bf06-839fb0e8d68e None None] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:57.107737 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:57.108391 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:57.108648 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:57.108915 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:57.110680 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:57.121833 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:57.123957 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:57.133910 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1390/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:57.822837 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:57.834721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1019d65-365d-451b-866a-b652cc8e5ac7 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:57.839878 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:57.840788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:57.841559 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:57.841819 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] PATH_INFO: `/v3/users/e60e6a888a5a4f8b9a0be145bca7cb85` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:57.843212 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60e6a888a5a4f8b9a0be145bca7cb85)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:57.845145 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:57.894721 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60e6a888a5a4f8b9a0be145bca7cb85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:57.902703 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60e6a888a5a4f8b9a0be145bca7cb85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:57.914968 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60e6a888a5a4f8b9a0be145bca7cb85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:57.921558 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60e6a888a5a4f8b9a0be145bca7cb85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:57.922255 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60e6a888a5a4f8b9a0be145bca7cb85'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:57.927981 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1420/2810] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:03:57 2021] DELETE /identity/v3/users/e60e6a888a5a4f8b9a0be145bca7cb85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:03:58.129042 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:58.142325 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1f119-a453-46c4-8751-9815054ad468 service placement] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:58.221854 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:58.222746 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:58.223166 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:58.223515 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] PATH_INFO: `/v3/projects/ee8af7ba39fb4329a2a331f5139cfacf` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:58.225003 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8af7ba39fb4329a2a331f5139cfacf)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:58.226998 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:58.279772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8af7ba39fb4329a2a331f5139cfacf', 'request_id': 'req-7a9d280d-477f-416c-ad79-d74da7804f1d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:58.286148 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8af7ba39fb4329a2a331f5139cfacf', 'request_id': 'req-7a9d280d-477f-416c-ad79-d74da7804f1d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:58.291466 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8af7ba39fb4329a2a331f5139cfacf', 'request_id': 'req-7a9d280d-477f-416c-ad79-d74da7804f1d'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:58.304066 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] The token cache is being invalidate because project ee8af7ba39fb4329a2a331f5139cfacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:03:58.304425 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:58.305414 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:03:58.307005 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1391/2811] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:03:58 2021] DELETE /identity/v3/projects/ee8af7ba39fb4329a2a331f5139cfacf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:03:58.816542 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:58.818133 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:58.877439 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15161d-feb2-4770-a978-7ba63ab439a9 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:58.923365 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:58.924020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:58.924301 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:58.924590 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:58.926401 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:58.935372 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:58.936795 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:58.944693 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1421/2812] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:58 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:03:59.565759 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:03:59.568224 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:59.679908 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d280d-477f-416c-ad79-d74da7804f1d admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:03:59.687289 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:03:59.688029 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:03:59.688373 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:03:59.688717 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:03:59.690630 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:03:59.704028 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:03:59.705701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:03:59.717937 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1392/2813] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:03:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:09.098579 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:09.100102 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:09.116667 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c090d4-086d-4719-acf5-365b508db8a8 service neutron] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:09.122032 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0942cb70c474b06a9ea51db2f3298c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:09.122851 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:09.123739 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:09.124020 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:09.126088 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:09.138070 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:09.139692 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:09.150081 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1422/2814] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:06:04.518945 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:04.520392 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:04.559332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b938e-6ccc-4611-aa17-c92c3aa6a14b service nova] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:04.563054 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa9eafe94021438cbcdae8466277f9d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:04.563691 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:04.563967 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:04.564762 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:04.566511 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:04.667772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:04.669238 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:04.688400 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1393/2815] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:06:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 17:06:11.116117 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:11.117796 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:11.163757 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7685af-e914-4b88-8229-f850939576f9 service nova] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:11.168847 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:11.169745 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:11.170021 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:11.170293 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] PATH_INFO: `/v3/users/0fb66c98af9c4aefaa046ab6fe2e54d3` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:11.171495 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb66c98af9c4aefaa046ab6fe2e54d3)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:11.173658 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:11.218684 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb66c98af9c4aefaa046ab6fe2e54d3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.225428 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb66c98af9c4aefaa046ab6fe2e54d3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.236818 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb66c98af9c4aefaa046ab6fe2e54d3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.243758 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb66c98af9c4aefaa046ab6fe2e54d3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.244407 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb66c98af9c4aefaa046ab6fe2e54d3'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.250433 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1423/2816] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:06:11 2021] DELETE /identity/v3/users/0fb66c98af9c4aefaa046ab6fe2e54d3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:06:11.422376 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:11.433413 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f369bf-b6c4-44c2-aa1b-1a0aeda2fbbb service neutron] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:11.492097 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:11.492965 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:11.493279 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:11.493555 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] PATH_INFO: `/v3/projects/a7fa28445b9049f88d60d9dc59087c60` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:11.494750 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fa28445b9049f88d60d9dc59087c60)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:11.496647 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:11.540809 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fa28445b9049f88d60d9dc59087c60', 'request_id': 'req-3454f7c6-0ee0-4ac7-8b89-74f64443896f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.546687 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fa28445b9049f88d60d9dc59087c60', 'request_id': 'req-3454f7c6-0ee0-4ac7-8b89-74f64443896f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.552561 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fa28445b9049f88d60d9dc59087c60', 'request_id': 'req-3454f7c6-0ee0-4ac7-8b89-74f64443896f'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.564178 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] The token cache is being invalidate because project a7fa28445b9049f88d60d9dc59087c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:06:11.564467 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.565132 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.566655 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1394/2817] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:06:11 2021] DELETE /identity/v3/projects/a7fa28445b9049f88d60d9dc59087c60 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:06:11.570723 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:11.572257 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:11.586571 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3b004-347e-47d7-8d68-9ef42b4cc9ab admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:11.640810 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:11.641628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:11.641908 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:11.642181 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] PATH_INFO: `/v3/users/2dbda78908b44bec9586b17f71e6006f` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:11.643975 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbda78908b44bec9586b17f71e6006f)` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:11.645928 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:11.689329 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbda78908b44bec9586b17f71e6006f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.697236 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbda78908b44bec9586b17f71e6006f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.709620 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbda78908b44bec9586b17f71e6006f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.716210 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbda78908b44bec9586b17f71e6006f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.716876 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.notifications [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbda78908b44bec9586b17f71e6006f'} {{(pid=73568) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:11.722740 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1424/2818] 10.222.0.42 () {58 vars in 1223 bytes} [Tue Oct 12 17:06:11 2021] DELETE /identity/v3/users/2dbda78908b44bec9586b17f71e6006f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:06:11.890241 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:11.891718 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:11.905423 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454f7c6-0ee0-4ac7-8b89-74f64443896f admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:11.962492 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12c2b7d3088e4259a65e864f8c35d8fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0ea88d5877948298aefb26cf4ba2957', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:11.963354 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:11.963634 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:11.963907 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] PATH_INFO: `/v3/projects/f5be202cae47470fa69ceab5209c8f6b` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:11.965129 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5be202cae47470fa69ceab5209c8f6b)` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:11.967022 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:12.011055 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5be202cae47470fa69ceab5209c8f6b', 'request_id': 'req-62a0a040-f7ff-47a0-b767-9cd7c7e52245'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:12.016878 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5be202cae47470fa69ceab5209c8f6b', 'request_id': 'req-62a0a040-f7ff-47a0-b767-9cd7c7e52245'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:12.022051 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5be202cae47470fa69ceab5209c8f6b', 'request_id': 'req-62a0a040-f7ff-47a0-b767-9cd7c7e52245'} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:12.033779 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] The token cache is being invalidate because project f5be202cae47470fa69ceab5209c8f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73567) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:06:12.034064 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:12.034683 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.notifications [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73567) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:06:12.036194 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1395/2819] 10.222.0.42 () {58 vars in 1232 bytes} [Tue Oct 12 17:06:11 2021] DELETE /identity/v3/projects/f5be202cae47470fa69ceab5209c8f6b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:06:28.527871 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Authenticating user token {{(pid=73568) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:06:28.529432 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:28.616868 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe20fa-05c0-4c52-98f4-11e482b8ff85 admin admin] Validating token access rules against request {{(pid=73568) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:06:28.671600 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73568) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:06:28.672239 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] REQUEST_METHOD: `GET` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:06:28.672518 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] SCRIPT_NAME: `/identity` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:06:28.672788 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73568) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:06:28.674628 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.fernet_utils [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73568) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:06:28.685660 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:06:28.687229 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daff9f-1dae-403d-849e-7f25b80465d7 service placement] RBAC: Authorization granted {{(pid=73568) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:06:28.697370 dv-cinder-813223-2-iscsi devstack@keystone.service[73568]: [pid: 73568|app: 0|req: 1425/2820] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:06:28 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:11:33.517774 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Authenticating user token {{(pid=73567) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:11:33.519332 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.fernet_utils [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73567) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:11:33.534571 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a040-f7ff-47a0-b767-9cd7c7e52245 admin admin] Validating token access rules against request {{(pid=73567) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:11:33.539581 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df7a67d7326462582f66270c29c0fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c74cc4598a854c96b3b095a032553e37', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73567) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:11:33.540219 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] REQUEST_METHOD: `GET` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:11:33.540501 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] SCRIPT_NAME: `/identity` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:11:33.540772 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73567) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:11:33.549140 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:11:33.550701 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bfa30-ae0b-4da5-a460-dc62824244fb service placement] RBAC: Authorization granted {{(pid=73567) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:11:33.561244 dv-cinder-813223-2-iscsi devstack@keystone.service[73567]: [pid: 73567|app: 0|req: 1396/2821] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Oct 12 17:11:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)